Jul 27 20:51:13.587846 ip-10-0-141-50 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:51:14.006865 ip-10-0-141-50 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:51:14.006865 ip-10-0-141-50 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:51:14.006865 ip-10-0-141-50 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:51:14.006865 ip-10-0-141-50 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:51:14.006865 ip-10-0-141-50 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:51:14.008005 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.007879    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:51:14.011542 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011518    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011548    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011554    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011557    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011560    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011562    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011565    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011568    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011571    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011574    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011577    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011580    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011583    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011585    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011588    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011591    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:14.011586 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011593    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011596    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011599    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011602    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011604    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011607    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011609    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011617    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011620    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011623    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011625    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011628    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011630    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011632    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011635    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011637    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011639    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011642    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011644    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011647    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:14.011967 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011649    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011652    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011654    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011657    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011659    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011662    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011664    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011667    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011671    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011674    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011677    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011679    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011683    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011685    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011689    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011692    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011694    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011697    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011699    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011702    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:14.012447 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011705    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011707    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011710    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011712    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011715    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011719    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011721    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011724    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011727    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011729    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011732    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011735    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011738    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011740    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011743    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011746    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011749    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011751    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011754    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:14.012968 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011756    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011759    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011764    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011768    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011773    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011776    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011779    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011782    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011785    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011788    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011791    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011793    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011796    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011799    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011802    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011805    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011808    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011811    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011814    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:14.013428 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011816    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011819    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011822    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011824    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.011827    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012571    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012579    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012582    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012585    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012588    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012592    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012595    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012598    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012600    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012603    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012606    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012609    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012612    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012615    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012617    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:14.013914 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012620    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012623    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012625    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012628    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012630    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012633    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012635    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012638    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012640    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012643    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012645    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012648    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012650    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012654    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012657    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012659    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012662    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012664    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012667    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012670    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:14.014408 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012672    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012675    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012677    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012680    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012683    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012685    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012690    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012694    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012697    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012700    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012703    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012705    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012708    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012711    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012715    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012718    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012721    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012723    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012726    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:14.014906 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012729    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012731    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012734    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012736    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012739    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012742    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012744    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012747    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012750    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012752    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012755    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012757    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012761    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012764    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012768    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012770    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012773    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012776    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012779    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:14.015358 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012782    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012784    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012787    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012790    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012792    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012795    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012798    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012800    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012803    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012807    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012809    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012812    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012815    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012817    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012820    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012822    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012825    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012828    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012830    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:14.015850 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012834    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012837    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012839    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012842    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012844    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012847    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.012849    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013303    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013309    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013313    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013315    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013319    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013322    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013324    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013328    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013330    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013333    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013335    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013340    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:14.016333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013343    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013346    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013349    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013351    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013354    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013356    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013359    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013362    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013365    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013367    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013370    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013372    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013375    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013377    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013380    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013382    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013386    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013388    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013391    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:14.016836 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013393    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013396    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013398    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013401    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013403    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013406    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013409    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013412    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013414    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013417    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013419    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013422    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013425    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013427    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013430    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013433    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013435    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013438    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013441    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013444    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:14.017288 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013447    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013449    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013451    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013454    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013456    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013459    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013462    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013464    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013467    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013469    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013471    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013474    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013476    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013479    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013481    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013484    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013488    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013492    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013495    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013498    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:14.017839 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013501    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013504    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013506    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013509    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013511    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013514    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013516    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013519    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013521    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013524    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013526    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013548    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013551    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013553    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013556    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013558    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013561    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013564    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013570    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:14.018326 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013573    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013576    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013579    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013582    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013585    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013588    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013590    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013593    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.013596    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013668    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013675    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013682    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013687    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013693    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013696    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013701    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013706    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013709    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013712    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013715    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013719    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013722    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:51:14.018793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013725    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013728    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013734    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013738    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013743    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013749    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013754    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013758    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013763    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013768    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013772    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013775    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013778    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013781    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013785    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013788    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013790    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013793    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013796    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013801    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013804    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013807    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013810    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013814    2566 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013826    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:51:14.019354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013831    2566 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013834    2566 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013838    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013841    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013844    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013852    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013855    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013858    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013861    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013865    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013868    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013871    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013874    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013877    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013880    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013883    2566 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013887    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013890    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013893    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013896    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013899    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013902    2566 flags.go:64] FLAG: --help="false"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013905    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013908    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:51:14.019989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013911    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013913    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013917    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013921    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013924    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013927    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013931    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013934    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013938    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013941    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013944    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013947    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013950    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013953    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013956    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013959    2566 flags.go:64] FLAG: --lock-file=""
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013962    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013967    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013970    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013976    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013979    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013982    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013984    2566 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:51:14.020600 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013987    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013991    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013994    2566 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.013997    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014002    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014004    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014009    2566 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014012    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014015    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014018    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014021    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014024    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014027    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014029    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014037    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014043    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014046    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014049    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014053    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014058    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014062    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014065    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014068    2566 flags.go:64] FLAG: --port="10250"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014071    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:51:14.021201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014074    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a83d81845ac7b61e"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014077    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014081    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014084    2566 flags.go:64] FLAG: --register-node="true"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014087    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014090    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014093    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014096    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014099    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014103    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014106    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014109    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014111    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014114    2566 flags.go:64] FLAG: --runonce="false"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014117    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014120    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014123    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014126    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014128    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014131    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014135    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014138    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014140    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014144    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014147    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014150    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:51:14.021865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014153    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014157    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014160    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014165    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014168    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014171    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014175    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014178    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014182    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014185    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014187    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014190    2566 flags.go:64] FLAG: --v="2"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014194    2566 flags.go:64] FLAG: --version="false"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014198    2566 flags.go:64] FLAG: --vmodule=""
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014202    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.014205    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014322    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014325    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014328    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014333    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014337    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014340    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014342    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:14.022564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014345    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014348    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014351    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014354    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014357    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014360    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014362    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014366    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014369    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014371    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014375    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014379    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014383    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014386    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014389    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014392    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014395    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014399    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014402    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014405    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:14.023160 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014407    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014410    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014413    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014416    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014419    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014421    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014424    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014427    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014429    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014432    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014434    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014437    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014440    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014442    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014445    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014448    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014450    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014453    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014455    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014459    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:14.023675 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014481    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014486    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014490    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014492    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014502    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014506    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014508    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014511    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014514    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014517    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014520    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014523    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014525    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014528    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014544    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014547    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014550    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014553    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014555    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014558    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:14.024169 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014560    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014563    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014566    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014568    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014571    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014573    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014576    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014579    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014581    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014584    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014587    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014591    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014593    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014596    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014599    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014601    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014604    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014607    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014610    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014612    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:14.024684 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014615    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014617    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014620    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014622    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014625    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014628    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014630    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014633    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014635    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014638    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014641    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.014645    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.015368    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.022401    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.022417    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:51:14.025161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.023332    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.023344    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023441    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023447    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023451    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023454    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023457    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023460    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023464    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023466    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023469    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023472    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023475    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023478    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023481    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023484    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023486    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023489    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023491    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:14.025628 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023494    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023499    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023502    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023505    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023508    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023511    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023514    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023517    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023520    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023523    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023525    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023527    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023550    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023554    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023557    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023560    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023562    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023565    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023568    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:14.026089 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023571    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023574    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023578    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023581    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023583    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023586    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023590    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023592    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023595    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023598    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023602    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023606    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023609    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023612    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023615    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023617    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023620    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023623    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023625    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:14.026579 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023628    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023631    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023633    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023636    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023638    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023641    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023644    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023647    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023650    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023652    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023655    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023657    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023660    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023663    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023665    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023668    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023670    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023672    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023675    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:14.027033 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023678    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023680    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023683    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023686    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023691    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023694    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023696    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023699    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023702    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023704    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023707    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023709    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023712    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023714    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023717    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023719    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023722    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023724    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023727    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023730    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:14.027483 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023733    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023735    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023738    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023741    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023744    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.023749    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023872    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023878    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023881    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023884    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023887    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023890    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023892    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023895    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:51:14.027988 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023898    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023900    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023903    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023906    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023908    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023910    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023913    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023915    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023918    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023920    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023923    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023926    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023928    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023930    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023933    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023935    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023938    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023941    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023944    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023946    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:51:14.028340 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023949    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023951    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023954    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023956    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023959    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023962    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023965    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023967    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023970    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023972    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023975    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023977    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023979    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023982    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023984    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023986    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023990    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023992    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023995    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.023997    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:51:14.028860 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024000    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024002    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024004    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024007    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024009    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024012    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024014    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024017    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024019    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024022    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024025    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024028    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024030    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024033    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024036    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024039    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024041    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024045    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024049    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:51:14.029342 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024052    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024055    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024057    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024060    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024063    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024065    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024068    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024071    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024073    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024075    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024078    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024081    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024083    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024086    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024088    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024090    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024094    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024098    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024101    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:51:14.029862 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024104    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024107    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024109    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024112    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024115    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024117    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024120    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024123    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024126    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024128    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024131    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024133    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:14.024136    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.024141    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.024259    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:51:14.030307 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.026091    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:51:14.030756 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.027408    2566 server.go:1019] "Starting client certificate rotation"
Jul 27 20:51:14.030756 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.027514    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:51:14.030756 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.028326    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:51:14.030756 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.029635    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:51:14.032283 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.032259    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:51:14.043035 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.043014    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:51:14.046354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.046333    2566 log.go:25] "Validated CRI v1 image API"
Jul 27 20:51:14.047197 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.047182    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:51:14.052718 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.052696    2566 fs.go:135] Filesystem UUIDs: map[65ec1a6f-5ac5-442a-8d36-d846f62a38fe:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ce649a84-1dca-4037-9c4c-b1c91811fe65:/dev/nvme0n1p4]
Jul 27 20:51:14.052779 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.052718    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:51:14.057363 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.057213    2566 manager.go:216] Machine: {Timestamp:2026-07-27 20:51:14.056727932 +0000 UTC m=+0.353059241 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3122126 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26defa4424cd12bf09de4007f0265d SystemUUID:ec26defa-4424-cd12-bf09-de4007f0265d BootID:dab7587f-d2f0-42cf-b876-623627d94eb9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:fc:e8:a3:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:fc:e8:a3:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:09:d3:e2:6f:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:51:14.057363 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.057354    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:51:14.057552 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.057439    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:51:14.057618 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.057599    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:51:14.060319 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.060285    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:51:14.060506 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.060322    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-50.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:51:14.061096 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.061084    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:51:14.061149 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.061102    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:51:14.061149 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.061113    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:51:14.061898 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.061881    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:51:14.062613 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.062600    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:51:14.064430 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.064415    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:51:14.064596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.064585    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:51:14.064666 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.064626    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:51:14.064666 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.064655    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:51:14.064752 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.064677    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:51:14.064752 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.064698    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:51:14.064752 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.064723    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:51:14.065153 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.065140    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:51:14.065225 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.065180    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:51:14.067624 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.067608    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:51:14.069260 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.069245    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:51:14.069327 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.069276    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:51:14.071035 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071023    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:51:14.071075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071041    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:51:14.071075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071049    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:51:14.071075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071054    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:51:14.071075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071063    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:51:14.071075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071069    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:51:14.071229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071077    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:51:14.071229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071084    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:51:14.071229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071091    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:51:14.071229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071096    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:51:14.071229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071106    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:51:14.071229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071112    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:51:14.071758 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071748    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:51:14.071758 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.071758    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:51:14.074970 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.074958    2566 server.go:1268] "Started kubelet"
Jul 27 20:51:14.075095 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.075049    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:51:14.075183 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.075154    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-50.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:51:14.075370 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.075300    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:51:14.075455 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.075390    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:51:14.075880 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.075858    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:51:14.075929 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.075859    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:51:14.076924 ip-10-0-141-50 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:51:14.079832 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.079808    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:51:14.080900 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.080848    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:51:14.081384 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.081366    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:51:14.083574 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.083510    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcc2h"
Jul 27 20:51:14.084698 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.083824    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-50.ec2.internal.18c640baf86c6703  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-50.ec2.internal,UID:ip-10-0-141-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-50.ec2.internal,},FirstTimestamp:2026-07-27 20:51:14.074928899 +0000 UTC m=+0.371260209,LastTimestamp:2026-07-27 20:51:14.074928899 +0000 UTC m=+0.371260209,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-50.ec2.internal,}"
Jul 27 20:51:14.085287 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.085273    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:51:14.085334 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.085290    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:51:14.085711 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.085447    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.085808 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.085777    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:51:14.085808 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.085797    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:51:14.085924 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.085808    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:51:14.085924 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.085882    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:51:14.085924 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.085889    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:51:14.086098 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086078    2566 factory.go:55] Registering systemd factory
Jul 27 20:51:14.086098 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086099    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:51:14.086351 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086336    2566 factory.go:153] Registering CRI-O factory
Jul 27 20:51:14.086351 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086352    2566 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:51:14.086484 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086426    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:51:14.086484 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086462    2566 factory.go:103] Registering Raw factory
Jul 27 20:51:14.086484 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086477    2566 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:51:14.086875 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.086863    2566 manager.go:349] Starting recovery of all containers
Jul 27 20:51:14.089338 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.089312    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vcc2h"
Jul 27 20:51:14.094983 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.094947    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:51:14.095229 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.095104    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:51:14.096653 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.096635    2566 manager.go:354] Recovery completed
Jul 27 20:51:14.098757 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.098726    2566 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 27 20:51:14.102171 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.102158    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:14.104033 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.104017    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:14.104086 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.104048    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:14.104086 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.104059    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:14.104672 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.104658    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:51:14.104672 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.104670    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:51:14.104780 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.104680    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:14.104780 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.104684    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:51:14.105397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.105380    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:14.105468 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.105408    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:14.105468 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.105421    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:14.106027 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.106014    2566 policy_none.go:49] "None policy: Start"
Jul 27 20:51:14.106077 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.106031    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:51:14.106077 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.106041    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:51:14.106967 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.106956    2566 policy_none.go:47] "Start"
Jul 27 20:51:14.141437 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.141283    2566 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:51:14.141560 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.141455    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:51:14.141560 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.141466    2566 server.go:87] "Starting device plugin registration server"
Jul 27 20:51:14.141713 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.141703    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:51:14.141744 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.141716    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:51:14.142063 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.142044    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:51:14.142136 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.142119    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:51:14.142136 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.142135    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:51:14.143142 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.143119    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:51:14.143250 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.143175    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.234995 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.234955    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:51:14.236453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.236430    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:51:14.236596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.236484    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:51:14.236596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.236524    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:51:14.236596 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.236585    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:51:14.238801 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.238779    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:14.242637 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.242622    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:14.243468 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.243451    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:14.243572 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.243485    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:14.243572 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.243501    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:14.243679 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.243576    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.251256 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.251239    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.251329 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.251266    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-50.ec2.internal\": node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.267730 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.267655    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.337743 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.337704    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal"]
Jul 27 20:51:14.337902 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.337793    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:14.339281 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.339258    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:14.339410 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.339297    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:14.339410 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.339307    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:14.340638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.340625    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:14.340830 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.340814    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.340889 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.340850    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:14.341899 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.341880    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:14.341987 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.341912    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:14.341987 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.341923    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:14.341987 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.341889    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:14.341987 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.341977    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:14.341987 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.341988    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:14.343232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.343217    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.343291 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.343244    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:51:14.344048 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.344031    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:51:14.344130 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.344059    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:51:14.344130 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.344070    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:51:14.367796 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.367755    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.373576 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.373530    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-50.ec2.internal\" not found" node="ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.378309 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.378289    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-50.ec2.internal\" not found" node="ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.387496 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.387470    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d0794185faca7077a864950fb56bc94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal\" (UID: \"5d0794185faca7077a864950fb56bc94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.387601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.387503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0794185faca7077a864950fb56bc94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal\" (UID: \"5d0794185faca7077a864950fb56bc94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.387601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.387522    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2efc845f7ae190bc5a73ce1b56253af6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-50.ec2.internal\" (UID: \"2efc845f7ae190bc5a73ce1b56253af6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.468013 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.467980    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.488213 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.488183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d0794185faca7077a864950fb56bc94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal\" (UID: \"5d0794185faca7077a864950fb56bc94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.488286 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.488216    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0794185faca7077a864950fb56bc94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal\" (UID: \"5d0794185faca7077a864950fb56bc94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.488286 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.488236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2efc845f7ae190bc5a73ce1b56253af6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-50.ec2.internal\" (UID: \"2efc845f7ae190bc5a73ce1b56253af6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.488364 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.488293    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2efc845f7ae190bc5a73ce1b56253af6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-50.ec2.internal\" (UID: \"2efc845f7ae190bc5a73ce1b56253af6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.488364 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.488295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d0794185faca7077a864950fb56bc94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal\" (UID: \"5d0794185faca7077a864950fb56bc94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.488364 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.488302    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d0794185faca7077a864950fb56bc94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal\" (UID: \"5d0794185faca7077a864950fb56bc94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.568666 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.568584    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.669168 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.669128    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.676338 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.676313    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.681215 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.681189    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:14.770278 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.770237    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.870858 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.870755    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:14.944171 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:14.944146    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:14.971866 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:14.971823    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:15.027324 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.027295    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:51:15.027831 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.027477    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:51:15.027831 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.027477    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:51:15.072783 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:15.072747    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:15.093529 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.093488    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:46:14 +0000 UTC" deadline="2028-04-08 19:11:00.352614014 +0000 UTC"
Jul 27 20:51:15.093529 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.093519    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14902h19m45.259099811s"
Jul 27 20:51:15.173424 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:15.173352    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:15.203703 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:15.203660    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0794185faca7077a864950fb56bc94.slice/crio-8e591e47bc47ae244b46c994ad5a40fa6a1e9f7a79bbda72f0136349f33bd1e5 WatchSource:0}: Error finding container 8e591e47bc47ae244b46c994ad5a40fa6a1e9f7a79bbda72f0136349f33bd1e5: Status 404 returned error can't find the container with id 8e591e47bc47ae244b46c994ad5a40fa6a1e9f7a79bbda72f0136349f33bd1e5
Jul 27 20:51:15.203886 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:15.203866    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efc845f7ae190bc5a73ce1b56253af6.slice/crio-d275815d34751ab5954d98e5f41a080625dcf640555f1a0447b2cc2fcbdf68c9 WatchSource:0}: Error finding container d275815d34751ab5954d98e5f41a080625dcf640555f1a0447b2cc2fcbdf68c9: Status 404 returned error can't find the container with id d275815d34751ab5954d98e5f41a080625dcf640555f1a0447b2cc2fcbdf68c9
Jul 27 20:51:15.208895 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.208877    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:51:15.240794 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.240737    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal" event={"ID":"5d0794185faca7077a864950fb56bc94","Type":"ContainerStarted","Data":"8e591e47bc47ae244b46c994ad5a40fa6a1e9f7a79bbda72f0136349f33bd1e5"}
Jul 27 20:51:15.241727 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.241706    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal" event={"ID":"2efc845f7ae190bc5a73ce1b56253af6","Type":"ContainerStarted","Data":"d275815d34751ab5954d98e5f41a080625dcf640555f1a0447b2cc2fcbdf68c9"}
Jul 27 20:51:15.273907 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:15.273875    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:15.374405 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:15.374366    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-50.ec2.internal\" not found"
Jul 27 20:51:15.403756 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.403732    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:15.457879 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.457802    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:15.486161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.486134    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:15.498926 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.498900    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:51:15.499973 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.499955    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal"
Jul 27 20:51:15.509875 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:15.509839    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:51:16.066083 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.066048    2566 apiserver.go:52] "Watching apiserver"
Jul 27 20:51:16.076083 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.076047    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:51:16.079138 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.077982    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777","openshift-cluster-node-tuning-operator/tuned-j652r","openshift-dns/node-resolver-7tnkz","openshift-image-registry/node-ca-72wr4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal","openshift-multus/multus-additional-cni-plugins-c8pcm","openshift-network-diagnostics/network-check-target-mlmbw","kube-system/global-pull-secret-syncer-q2zh7","kube-system/konnectivity-agent-x58zc","openshift-multus/multus-8lj7n","openshift-multus/network-metrics-daemon-n7r7v","openshift-network-operator/iptables-alerter-nzmhn","openshift-ovn-kubernetes/ovnkube-node-zks2z"]
Jul 27 20:51:16.080048 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.080026    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.081389 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.081364    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.082479 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.082453    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.083154 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.083130    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:51:16.083252 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.083201    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xrs2s\""
Jul 27 20:51:16.083614 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.083592    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:51:16.083906 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.083888    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.084581 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.084540    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:51:16.085062 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085038    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:51:16.085283 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085265    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:51:16.085407 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085366    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:51:16.085407 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085389    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:51:16.085407 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085402    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:51:16.085573 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085331    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vjpkp\""
Jul 27 20:51:16.085573 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085316    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:51:16.085573 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085281    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tr2bm\""
Jul 27 20:51:16.085754 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085640    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.085808 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085787    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:51:16.085963 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.085914    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:51:16.086162 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.086145    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:16.086252 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.086211    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:16.088124 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.088097    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:51:16.088719 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.088700    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.088812 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.088784    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:16.090083 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.090062    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gtnqd\""
Jul 27 20:51:16.090293 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.090277    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:51:16.090365 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.090336    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4zr2m\""
Jul 27 20:51:16.090425 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.090386    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:51:16.090517 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.090337    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:51:16.090601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.090532    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:51:16.090715 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.090632    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.092199 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.091892    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.093144 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.093122    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:16.093263 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.093238    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:16.094467 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.094450    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.095763 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.095739    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c7lql\""
Jul 27 20:51:16.095886 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.095869    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.096507 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.096489    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:51:16.096598 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.096520    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:51:16.096598 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.096588    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z7xs7\""
Jul 27 20:51:16.096757 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.096737    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:51:16.097877 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097668    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:51:16.097877 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097686    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vkptk\""
Jul 27 20:51:16.097877 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097689    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:51:16.097877 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097788    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-modprobe-d\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.097877 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097810    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:51:16.097877 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097821    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysconfig\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.097877 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097860    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-socket-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-device-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097914    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-cnibin\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097941    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.097996    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqxzc\" (UniqueName: \"kubernetes.io/projected/0b901120-f94d-49bf-8098-cd196b635d7a-kube-api-access-vqxzc\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysctl-d\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098035    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-lib-modules\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-registration-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098108    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd8697-f1fe-44bc-a652-50a9903c07d5-tmp-dir\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098138    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098160    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysctl-conf\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098176    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-run\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-host\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098209    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzv9\" (UniqueName: \"kubernetes.io/projected/b170b467-7f3d-4f59-9c72-b209db120b2b-kube-api-access-5wzv9\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.098232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098237    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/251732b1-eb60-40ec-bf31-81a031ab1393-serviceca\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-var-lib-kubelet\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098296    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d45ae4f1-15ec-4d11-8576-767169e717af-etc-tuned\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-sys-fs\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098356    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm9c4\" (UniqueName: \"kubernetes.io/projected/13bd8697-f1fe-44bc-a652-50a9903c07d5-kube-api-access-tm9c4\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098384    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjg5c\" (UniqueName: \"kubernetes.io/projected/251732b1-eb60-40ec-bf31-81a031ab1393-kube-api-access-wjg5c\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098414    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-system-cni-dir\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098436    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098476    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-systemd\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098584    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d45ae4f1-15ec-4d11-8576-767169e717af-tmp\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098628    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-kubernetes\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098644    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/251732b1-eb60-40ec-bf31-81a031ab1393-host\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098675    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-os-release\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.099071 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098694    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-sys\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.099733 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098711    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxw24\" (UniqueName: \"kubernetes.io/projected/d45ae4f1-15ec-4d11-8576-767169e717af-kube-api-access-jxw24\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.099733 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.098764    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd8697-f1fe-44bc-a652-50a9903c07d5-hosts-file\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.099733 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.099069    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:51:16.099733 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.099078    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:51:16.099733 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.099726    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:51:16.099984 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.099776    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:51:16.099984 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.099875    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:51:16.100086 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.099999    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nwqx2\""
Jul 27 20:51:16.100164 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.100141    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:51:16.109261 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.109236    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:51:16.129935 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.129910    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7k9h6"
Jul 27 20:51:16.143395 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.143367    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7k9h6"
Jul 27 20:51:16.186841 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.186812    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:51:16.199192 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-sys\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199199    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de21674c-cccb-4c0e-af96-c949e951b0d4-dbus\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-os-release\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199248    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovnkube-script-lib\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-netns\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199307    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-socket-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199320    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-sys\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199333    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-device-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199360    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-system-cni-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.199386 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199379    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-cni-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199401    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-iptables-alerter-script\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199429    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199430    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-device-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199457    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199481    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-lib-modules\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-socket-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199559    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd8697-f1fe-44bc-a652-50a9903c07d5-tmp-dir\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199612    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysctl-conf\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-host\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199665    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzv9\" (UniqueName: \"kubernetes.io/projected/b170b467-7f3d-4f59-9c72-b209db120b2b-kube-api-access-5wzv9\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199694    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-lib-modules\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199691    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5-agent-certs\") pod \"konnectivity-agent-x58zc\" (UID: \"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5\") " pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199731    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-socket-dir-parent\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199769    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-daemon-config\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysctl-conf\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.199851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199828    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-cni-bin\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199870    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/251732b1-eb60-40ec-bf31-81a031ab1393-serviceca\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199894    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199907    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199919    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-var-lib-kubelet\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199946    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm9c4\" (UniqueName: \"kubernetes.io/projected/13bd8697-f1fe-44bc-a652-50a9903c07d5-kube-api-access-tm9c4\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.199972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-cni-bin\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200012    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-conf-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-multus-certs\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200084    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjg5c\" (UniqueName: \"kubernetes.io/projected/251732b1-eb60-40ec-bf31-81a031ab1393-kube-api-access-wjg5c\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200108    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-systemd\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200159    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd8697-f1fe-44bc-a652-50a9903c07d5-tmp-dir\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200165    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-etc-kubernetes\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200190    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200222    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-var-lib-kubelet\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-run-netns\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.200412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200263    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200316    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-host\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200448    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-log-socket\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200484    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d45ae4f1-15ec-4d11-8576-767169e717af-tmp\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200512    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8mjk\" (UniqueName: \"kubernetes.io/projected/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-kube-api-access-f8mjk\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200572    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200587    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/251732b1-eb60-40ec-bf31-81a031ab1393-serviceca\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200600    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-cnibin\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200650    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-systemd\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200697    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-systemd\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200702    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-env-overrides\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200733    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-os-release\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200761    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxw24\" (UniqueName: \"kubernetes.io/projected/d45ae4f1-15ec-4d11-8576-767169e717af-kube-api-access-jxw24\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200787    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd8697-f1fe-44bc-a652-50a9903c07d5-hosts-file\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de21674c-cccb-4c0e-af96-c949e951b0d4-kubelet-config\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.201026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200885    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-k8s-cni-cncf-io\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200916    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-etc-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200929    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-os-release\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-cni-netd\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200971    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovnkube-config\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200977    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd8697-f1fe-44bc-a652-50a9903c07d5-hosts-file\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.200998    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-cni-multus\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-modprobe-d\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysconfig\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-node-log\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7zfb\" (UniqueName: \"kubernetes.io/projected/4691fc08-6485-4873-8d0c-5539ee22b0ab-kube-api-access-c7zfb\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201141    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-kubelet\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201162    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-hostroot\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201180    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-cnibin\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201203    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqxzc\" (UniqueName: \"kubernetes.io/projected/0b901120-f94d-49bf-8098-cd196b635d7a-kube-api-access-vqxzc\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201245    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysctl-d\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201267    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysconfig\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.201768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-registration-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201299    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201314    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-cnibin\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201345    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-ovn\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201419    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-modprobe-d\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201498    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-registration-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-run\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d45ae4f1-15ec-4d11-8576-767169e717af-etc-tuned\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-sys-fs\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201603    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-sysctl-d\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfqts\" (UniqueName: \"kubernetes.io/projected/a7a5764f-13bb-42f3-8849-18b1e549631c-kube-api-access-hfqts\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2fc6\" (UniqueName: \"kubernetes.io/projected/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-kube-api-access-j2fc6\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201708    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovn-node-metrics-cert\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201736    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-system-cni-dir\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201838    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.202692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201867    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5-konnectivity-ca\") pod \"konnectivity-agent-x58zc\" (UID: \"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5\") " pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.201933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202013    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-kubernetes\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202040    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7a5764f-13bb-42f3-8849-18b1e549631c-cni-binary-copy\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-host-slash\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202094    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-kubelet\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-systemd-units\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202136    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-slash\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202189    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202210    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-etc-kubernetes\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b901120-f94d-49bf-8098-cd196b635d7a-system-cni-dir\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202248    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b170b467-7f3d-4f59-9c72-b209db120b2b-sys-fs\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202333    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-var-lib-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d45ae4f1-15ec-4d11-8576-767169e717af-run\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202398    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/251732b1-eb60-40ec-bf31-81a031ab1393-host\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202442    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/251732b1-eb60-40ec-bf31-81a031ab1393-host\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.203548 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.202563    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0b901120-f94d-49bf-8098-cd196b635d7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.205061 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.205035    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d45ae4f1-15ec-4d11-8576-767169e717af-tmp\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.205171 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.205075    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d45ae4f1-15ec-4d11-8576-767169e717af-etc-tuned\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.211905 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.211880    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:16.212042 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.211910    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:16.212042 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.211926    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc57r for pod openshift-network-diagnostics/network-check-target-mlmbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:16.212182 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.212115    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r podName:e7c26782-62b3-460a-b2ab-29c6db110c42 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:16.711987639 +0000 UTC m=+3.008318955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nc57r" (UniqueName: "kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r") pod "network-check-target-mlmbw" (UID: "e7c26782-62b3-460a-b2ab-29c6db110c42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:16.214821 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.214793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm9c4\" (UniqueName: \"kubernetes.io/projected/13bd8697-f1fe-44bc-a652-50a9903c07d5-kube-api-access-tm9c4\") pod \"node-resolver-7tnkz\" (UID: \"13bd8697-f1fe-44bc-a652-50a9903c07d5\") " pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.214947 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.214901    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzv9\" (UniqueName: \"kubernetes.io/projected/b170b467-7f3d-4f59-9c72-b209db120b2b-kube-api-access-5wzv9\") pod \"aws-ebs-csi-driver-node-wn777\" (UID: \"b170b467-7f3d-4f59-9c72-b209db120b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.215292 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.215241    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxw24\" (UniqueName: \"kubernetes.io/projected/d45ae4f1-15ec-4d11-8576-767169e717af-kube-api-access-jxw24\") pod \"tuned-j652r\" (UID: \"d45ae4f1-15ec-4d11-8576-767169e717af\") " pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.215594 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.215542    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjg5c\" (UniqueName: \"kubernetes.io/projected/251732b1-eb60-40ec-bf31-81a031ab1393-kube-api-access-wjg5c\") pod \"node-ca-72wr4\" (UID: \"251732b1-eb60-40ec-bf31-81a031ab1393\") " pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.216011 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.215987    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqxzc\" (UniqueName: \"kubernetes.io/projected/0b901120-f94d-49bf-8098-cd196b635d7a-kube-api-access-vqxzc\") pod \"multus-additional-cni-plugins-c8pcm\" (UID: \"0b901120-f94d-49bf-8098-cd196b635d7a\") " pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.302830 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.302793    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-system-cni-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.302830 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.302830    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-cni-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.302852    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-iptables-alerter-script\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.302924    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-system-cni-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.302936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.302977    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.302987    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5-agent-certs\") pod \"konnectivity-agent-x58zc\" (UID: \"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5\") " pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-socket-dir-parent\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303048    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-daemon-config\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303061    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-cni-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303094 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303078    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-cni-bin\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-cni-bin\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303151    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-conf-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303157    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-cni-bin\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303175    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-multus-certs\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303198    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-cni-bin\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-etc-kubernetes\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303228    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-conf-dir\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303121    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-socket-dir-parent\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303246    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-run-netns\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303267    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-multus-certs\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303275    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-etc-kubernetes\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303301    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-log-socket\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303330    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8mjk\" (UniqueName: \"kubernetes.io/projected/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-kube-api-access-f8mjk\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303348    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-run-netns\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.303546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303400    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-cnibin\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303429    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303454    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-systemd\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303459    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-log-socket\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303477    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-env-overrides\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303504    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de21674c-cccb-4c0e-af96-c949e951b0d4-kubelet-config\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303527    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-k8s-cni-cncf-io\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303540    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-iptables-alerter-script\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303557    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-etc-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.303583    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303608    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-etc-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303426    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303638    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-cni-netd\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.303662    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs podName:c1e263aa-bb6a-45c0-9cca-fcbf793f01a3 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:16.80363391 +0000 UTC m=+3.099965210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs") pod "network-metrics-daemon-n7r7v" (UID: "c1e263aa-bb6a-45c0-9cca-fcbf793f01a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-cni-netd\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303660    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-systemd\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303658    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-cnibin\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.304397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303679    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7a5764f-13bb-42f3-8849-18b1e549631c-multus-daemon-config\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303699    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-k8s-cni-cncf-io\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303731    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de21674c-cccb-4c0e-af96-c949e951b0d4-kubelet-config\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303765    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovnkube-config\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303792    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-cni-multus\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303905    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-node-log\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303917    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-cni-multus\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303934    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7zfb\" (UniqueName: \"kubernetes.io/projected/4691fc08-6485-4873-8d0c-5539ee22b0ab-kube-api-access-c7zfb\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303955    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-node-log\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303961    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-kubelet\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.303995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-hostroot\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304026    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304051    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-ovn\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304080    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfqts\" (UniqueName: \"kubernetes.io/projected/a7a5764f-13bb-42f3-8849-18b1e549631c-kube-api-access-hfqts\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304109    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2fc6\" (UniqueName: \"kubernetes.io/projected/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-kube-api-access-j2fc6\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304136    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovn-node-metrics-cert\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5-konnectivity-ca\") pod \"konnectivity-agent-x58zc\" (UID: \"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5\") " pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304213    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7a5764f-13bb-42f3-8849-18b1e549631c-cni-binary-copy\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-run-ovn\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304240    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-host-slash\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304266    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-kubelet\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304273    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-var-lib-kubelet\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304274    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovnkube-config\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-systemd-units\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-slash\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304325    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-hostroot\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304343    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-var-lib-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304373    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de21674c-cccb-4c0e-af96-c949e951b0d4-dbus\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.304400    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.304462    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret podName:de21674c-cccb-4c0e-af96-c949e951b0d4 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:16.804444297 +0000 UTC m=+3.100775606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret") pod "global-pull-secret-syncer-q2zh7" (UID: "de21674c-cccb-4c0e-af96-c949e951b0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304398    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-os-release\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304464    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-os-release\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304506    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovnkube-script-lib\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304536    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-netns\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304603    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7a5764f-13bb-42f3-8849-18b1e549631c-host-run-netns\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-env-overrides\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.305776 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304788    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-systemd-units\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304801    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-host-slash\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304839    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-kubelet\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304888    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-var-lib-openvswitch\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304933    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4691fc08-6485-4873-8d0c-5539ee22b0ab-host-slash\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.305002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de21674c-cccb-4c0e-af96-c949e951b0d4-dbus\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.304990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5-konnectivity-ca\") pod \"konnectivity-agent-x58zc\" (UID: \"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5\") " pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.305179    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovnkube-script-lib\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.305496    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7a5764f-13bb-42f3-8849-18b1e549631c-cni-binary-copy\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.306359 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.306048    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5-agent-certs\") pod \"konnectivity-agent-x58zc\" (UID: \"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5\") " pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.307836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.307811    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4691fc08-6485-4873-8d0c-5539ee22b0ab-ovn-node-metrics-cert\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.314209 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.314175    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8mjk\" (UniqueName: \"kubernetes.io/projected/fe0c1c74-f51d-413e-bc62-28ccc3e3ab96-kube-api-access-f8mjk\") pod \"iptables-alerter-nzmhn\" (UID: \"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96\") " pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.318043 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.317970    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfqts\" (UniqueName: \"kubernetes.io/projected/a7a5764f-13bb-42f3-8849-18b1e549631c-kube-api-access-hfqts\") pod \"multus-8lj7n\" (UID: \"a7a5764f-13bb-42f3-8849-18b1e549631c\") " pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.318525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.318503    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2fc6\" (UniqueName: \"kubernetes.io/projected/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-kube-api-access-j2fc6\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:16.318867 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.318848    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7zfb\" (UniqueName: \"kubernetes.io/projected/4691fc08-6485-4873-8d0c-5539ee22b0ab-kube-api-access-c7zfb\") pod \"ovnkube-node-zks2z\" (UID: \"4691fc08-6485-4873-8d0c-5539ee22b0ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.393748 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.393697    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7tnkz"
Jul 27 20:51:16.403117 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.403087    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-72wr4"
Jul 27 20:51:16.413380 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.413125    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8pcm"
Jul 27 20:51:16.418003 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.417978    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j652r"
Jul 27 20:51:16.424275 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.424242    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777"
Jul 27 20:51:16.431911 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.431884    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:16.439757 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.439732    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8lj7n"
Jul 27 20:51:16.447318 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.447299    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzmhn"
Jul 27 20:51:16.452853 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.452831    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:16.473594 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.473556    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:16.749256 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.749218    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:51:16.807785 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.807745    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:16.808006 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.807801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:16.808006 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:16.807859    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:16.808006 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.807947    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:16.808006 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.807976    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:16.808006 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.807988    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc57r for pod openshift-network-diagnostics/network-check-target-mlmbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:16.808006 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.807991    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:16.808006 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.807995    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:16.808378 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.808056    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r podName:e7c26782-62b3-460a-b2ab-29c6db110c42 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:17.808036485 +0000 UTC m=+4.104367800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc57r" (UniqueName: "kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r") pod "network-check-target-mlmbw" (UID: "e7c26782-62b3-460a-b2ab-29c6db110c42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:16.808378 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.808076    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret podName:de21674c-cccb-4c0e-af96-c949e951b0d4 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:17.808067073 +0000 UTC m=+4.104398372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret") pod "global-pull-secret-syncer-q2zh7" (UID: "de21674c-cccb-4c0e-af96-c949e951b0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:16.808378 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:16.808113    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs podName:c1e263aa-bb6a-45c0-9cca-fcbf793f01a3 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:17.808104278 +0000 UTC m=+4.104435583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs") pod "network-metrics-daemon-n7r7v" (UID: "c1e263aa-bb6a-45c0-9cca-fcbf793f01a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:17.093333 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:17.093299    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5b0a16_dbc4_4b87_ae82_f63eb2a27de5.slice/crio-154e076c99a569e8cd04c879c4c99b074d72582a63cd0be6205a3735fbbb2e19 WatchSource:0}: Error finding container 154e076c99a569e8cd04c879c4c99b074d72582a63cd0be6205a3735fbbb2e19: Status 404 returned error can't find the container with id 154e076c99a569e8cd04c879c4c99b074d72582a63cd0be6205a3735fbbb2e19
Jul 27 20:51:17.094978 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:17.094923    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251732b1_eb60_40ec_bf31_81a031ab1393.slice/crio-be8005aa6c3863d1f59f4de8faca07d74a051622bd6994a191c3609029ed7a6b WatchSource:0}: Error finding container be8005aa6c3863d1f59f4de8faca07d74a051622bd6994a191c3609029ed7a6b: Status 404 returned error can't find the container with id be8005aa6c3863d1f59f4de8faca07d74a051622bd6994a191c3609029ed7a6b
Jul 27 20:51:17.095574 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:17.095531    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45ae4f1_15ec_4d11_8576_767169e717af.slice/crio-ea26b1faca26deab2826c6f725e3c32a107122421b4f2113ae960089b59ed1ad WatchSource:0}: Error finding container ea26b1faca26deab2826c6f725e3c32a107122421b4f2113ae960089b59ed1ad: Status 404 returned error can't find the container with id ea26b1faca26deab2826c6f725e3c32a107122421b4f2113ae960089b59ed1ad
Jul 27 20:51:17.097010 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:17.096818    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a5764f_13bb_42f3_8849_18b1e549631c.slice/crio-c63beb0f7d0372f3d1f5305bf483025c8f0fd4c98f07cbac4264e95acfdb268b WatchSource:0}: Error finding container c63beb0f7d0372f3d1f5305bf483025c8f0fd4c98f07cbac4264e95acfdb268b: Status 404 returned error can't find the container with id c63beb0f7d0372f3d1f5305bf483025c8f0fd4c98f07cbac4264e95acfdb268b
Jul 27 20:51:17.100605 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:17.100576    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb170b467_7f3d_4f59_9c72_b209db120b2b.slice/crio-92be0eb2f47f05e0e5174b08ad67dc49057058cc3874bac723af84f2e057348a WatchSource:0}: Error finding container 92be0eb2f47f05e0e5174b08ad67dc49057058cc3874bac723af84f2e057348a: Status 404 returned error can't find the container with id 92be0eb2f47f05e0e5174b08ad67dc49057058cc3874bac723af84f2e057348a
Jul 27 20:51:17.101890 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:17.101862    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4691fc08_6485_4873_8d0c_5539ee22b0ab.slice/crio-c207426fa9af368f44e6ca382047c3c8c68906c8d8af4003011982e043a281c9 WatchSource:0}: Error finding container c207426fa9af368f44e6ca382047c3c8c68906c8d8af4003011982e043a281c9: Status 404 returned error can't find the container with id c207426fa9af368f44e6ca382047c3c8c68906c8d8af4003011982e043a281c9
Jul 27 20:51:17.105686 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:17.104730    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bd8697_f1fe_44bc_a652_50a9903c07d5.slice/crio-6078966e04ab86ed40fc835d56e0c148c8470ce071380b049212046eef560aec WatchSource:0}: Error finding container 6078966e04ab86ed40fc835d56e0c148c8470ce071380b049212046eef560aec: Status 404 returned error can't find the container with id 6078966e04ab86ed40fc835d56e0c148c8470ce071380b049212046eef560aec
Jul 27 20:51:17.146046 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.146010    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:46:16 +0000 UTC" deadline="2028-04-05 21:23:06.291570992 +0000 UTC"
Jul 27 20:51:17.146046 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.146042    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14832h31m49.145533696s"
Jul 27 20:51:17.237289 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.237076    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:17.237470 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.237426    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:17.250202 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.250156    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerStarted","Data":"0aec7470a32bb28f9394cc643b8403d6385f7fb3bb86556205cd053428763118"}
Jul 27 20:51:17.252490 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.252462    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7tnkz" event={"ID":"13bd8697-f1fe-44bc-a652-50a9903c07d5","Type":"ContainerStarted","Data":"6078966e04ab86ed40fc835d56e0c148c8470ce071380b049212046eef560aec"}
Jul 27 20:51:17.253738 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.253705    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8lj7n" event={"ID":"a7a5764f-13bb-42f3-8849-18b1e549631c","Type":"ContainerStarted","Data":"c63beb0f7d0372f3d1f5305bf483025c8f0fd4c98f07cbac4264e95acfdb268b"}
Jul 27 20:51:17.255062 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.255038    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-72wr4" event={"ID":"251732b1-eb60-40ec-bf31-81a031ab1393","Type":"ContainerStarted","Data":"be8005aa6c3863d1f59f4de8faca07d74a051622bd6994a191c3609029ed7a6b"}
Jul 27 20:51:17.256211 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.256188    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j652r" event={"ID":"d45ae4f1-15ec-4d11-8576-767169e717af","Type":"ContainerStarted","Data":"ea26b1faca26deab2826c6f725e3c32a107122421b4f2113ae960089b59ed1ad"}
Jul 27 20:51:17.257260 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.257232    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x58zc" event={"ID":"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5","Type":"ContainerStarted","Data":"154e076c99a569e8cd04c879c4c99b074d72582a63cd0be6205a3735fbbb2e19"}
Jul 27 20:51:17.259695 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.259670    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal" event={"ID":"2efc845f7ae190bc5a73ce1b56253af6","Type":"ContainerStarted","Data":"d17d6a6c4a6117722de5daa7a0a6eb9ccc0fe8cbef566d46fde9c5de11b7a31a"}
Jul 27 20:51:17.260939 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.260916    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzmhn" event={"ID":"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96","Type":"ContainerStarted","Data":"a2520ddc075ade5ad82015d527a8084fae922173af8642e13e8935c9b82c1974"}
Jul 27 20:51:17.262121 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.262101    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"c207426fa9af368f44e6ca382047c3c8c68906c8d8af4003011982e043a281c9"}
Jul 27 20:51:17.263132 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.263105    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777" event={"ID":"b170b467-7f3d-4f59-9c72-b209db120b2b","Type":"ContainerStarted","Data":"92be0eb2f47f05e0e5174b08ad67dc49057058cc3874bac723af84f2e057348a"}
Jul 27 20:51:17.815667 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.815603    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:17.815886 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.815704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:17.815886 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:17.815774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:17.816023 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.815910    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:17.816023 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.815948    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:17.816023 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.815958    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc57r for pod openshift-network-diagnostics/network-check-target-mlmbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:17.816178 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.816034    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r podName:e7c26782-62b3-460a-b2ab-29c6db110c42 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:19.81601775 +0000 UTC m=+6.112349048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc57r" (UniqueName: "kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r") pod "network-check-target-mlmbw" (UID: "e7c26782-62b3-460a-b2ab-29c6db110c42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:17.816469 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.816450    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:17.816582 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.816509    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs podName:c1e263aa-bb6a-45c0-9cca-fcbf793f01a3 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:19.81649226 +0000 UTC m=+6.112823562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs") pod "network-metrics-daemon-n7r7v" (UID: "c1e263aa-bb6a-45c0-9cca-fcbf793f01a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:17.816714 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.816675    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:17.816782 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:17.816723    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret podName:de21674c-cccb-4c0e-af96-c949e951b0d4 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:19.81670947 +0000 UTC m=+6.113040773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret") pod "global-pull-secret-syncer-q2zh7" (UID: "de21674c-cccb-4c0e-af96-c949e951b0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:18.146750 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:18.146638    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:46:16 +0000 UTC" deadline="2028-04-09 20:08:30.459420956 +0000 UTC"
Jul 27 20:51:18.146750 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:18.146694    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14927h17m12.312729731s"
Jul 27 20:51:18.237755 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:18.237721    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:18.237934 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:18.237876    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:18.238018 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:18.237926    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:18.238072 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:18.238052    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:18.277953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:18.277907    2566 generic.go:356] "Generic (PLEG): container finished" podID="5d0794185faca7077a864950fb56bc94" containerID="bb6a693b4b044270b259fa4dc275c4925793c5648b232eea9d2fde54b70ff881" exitCode=0
Jul 27 20:51:18.278132 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:18.278101    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal" event={"ID":"5d0794185faca7077a864950fb56bc94","Type":"ContainerDied","Data":"bb6a693b4b044270b259fa4dc275c4925793c5648b232eea9d2fde54b70ff881"}
Jul 27 20:51:18.296956 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:18.295280    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-50.ec2.internal" podStartSLOduration=2.29525347 podStartE2EDuration="2.29525347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:17.275020048 +0000 UTC m=+3.571351366" watchObservedRunningTime="2026-07-27 20:51:18.29525347 +0000 UTC m=+4.591584804"
Jul 27 20:51:19.237850 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:19.237810    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:19.238403 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.238040    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:19.313871 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:19.313831    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal" event={"ID":"5d0794185faca7077a864950fb56bc94","Type":"ContainerStarted","Data":"6a289cd7d9e71d8b56d9507de2ab670381f4e8df014172b2d959504eb983a3ad"}
Jul 27 20:51:19.332858 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:19.332255    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-50.ec2.internal" podStartSLOduration=3.332230707 podStartE2EDuration="3.332230707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:19.331677287 +0000 UTC m=+5.628008612" watchObservedRunningTime="2026-07-27 20:51:19.332230707 +0000 UTC m=+5.628562041"
Jul 27 20:51:19.836821 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:19.836768    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:19.837029 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:19.836831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:19.837029 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:19.836877    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:19.837153 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837029    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:19.837153 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837099    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret podName:de21674c-cccb-4c0e-af96-c949e951b0d4 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:23.837076896 +0000 UTC m=+10.133408199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret") pod "global-pull-secret-syncer-q2zh7" (UID: "de21674c-cccb-4c0e-af96-c949e951b0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:19.837273 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837199    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:19.837273 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837214    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:19.837273 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837227    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc57r for pod openshift-network-diagnostics/network-check-target-mlmbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:19.837273 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837266    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r podName:e7c26782-62b3-460a-b2ab-29c6db110c42 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:23.837254211 +0000 UTC m=+10.133585525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc57r" (UniqueName: "kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r") pod "network-check-target-mlmbw" (UID: "e7c26782-62b3-460a-b2ab-29c6db110c42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:19.837487 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837330    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:19.837487 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:19.837365    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs podName:c1e263aa-bb6a-45c0-9cca-fcbf793f01a3 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:23.837352549 +0000 UTC m=+10.133683850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs") pod "network-metrics-daemon-n7r7v" (UID: "c1e263aa-bb6a-45c0-9cca-fcbf793f01a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:20.238920 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:20.238877    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:20.239435 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:20.239009    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:20.239435 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:20.239178    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:20.239435 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:20.239310    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:21.237851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:21.237814    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:21.238044 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:21.237943    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:22.237784 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:22.237749    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:22.238226 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:22.237875    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:22.238226 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:22.237754    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:22.238326 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:22.238306    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:23.237709 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:23.237202    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:23.237709 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.237346    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:23.875885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:23.875952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:23.876014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876167    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876191    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876204    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc57r for pod openshift-network-diagnostics/network-check-target-mlmbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876269    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r podName:e7c26782-62b3-460a-b2ab-29c6db110c42 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:31.876248476 +0000 UTC m=+18.172579795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc57r" (UniqueName: "kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r") pod "network-check-target-mlmbw" (UID: "e7c26782-62b3-460a-b2ab-29c6db110c42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876710    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876762    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs podName:c1e263aa-bb6a-45c0-9cca-fcbf793f01a3 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:31.876746209 +0000 UTC m=+18.173077515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs") pod "network-metrics-daemon-n7r7v" (UID: "c1e263aa-bb6a-45c0-9cca-fcbf793f01a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876821    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:23.876908 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:23.876855    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret podName:de21674c-cccb-4c0e-af96-c949e951b0d4 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:31.876843841 +0000 UTC m=+18.173175144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret") pod "global-pull-secret-syncer-q2zh7" (UID: "de21674c-cccb-4c0e-af96-c949e951b0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:24.238308 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:24.238269    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:24.238724 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:24.238414    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:24.238891 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:24.238866    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:24.239000 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:24.238976    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:25.237639 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:25.237479    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:25.237846 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:25.237651    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:26.237569 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:26.237378    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:26.237569 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:26.237495    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:26.238092 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:26.237379    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:26.238092 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:26.238067    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:27.237349 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:27.237318    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:27.237523 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:27.237456    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:28.237769 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:28.237738    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:28.238263 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:28.237847    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:28.238263 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:28.238259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:28.238350 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:28.238335    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:29.236843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:29.236806    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:29.237011 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:29.236937    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:30.237371 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:30.237331    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:30.237836 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:30.237482    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:30.237836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:30.237497    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:30.237836 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:30.237621    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:31.236794 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:31.236752    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:31.237074 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.236907    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:31.939804 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:31.939756    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:31.939821    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:31.939872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.939929    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.939979    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.939994    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs podName:c1e263aa-bb6a-45c0-9cca-fcbf793f01a3 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:47.939978654 +0000 UTC m=+34.236309949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs") pod "network-metrics-daemon-n7r7v" (UID: "c1e263aa-bb6a-45c0-9cca-fcbf793f01a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.939999    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.940018    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.940030    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc57r for pod openshift-network-diagnostics/network-check-target-mlmbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.940035    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret podName:de21674c-cccb-4c0e-af96-c949e951b0d4 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:47.940019288 +0000 UTC m=+34.236350600 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret") pod "global-pull-secret-syncer-q2zh7" (UID: "de21674c-cccb-4c0e-af96-c949e951b0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:31.940267 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:31.940075    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r podName:e7c26782-62b3-460a-b2ab-29c6db110c42 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:47.940059285 +0000 UTC m=+34.236390598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc57r" (UniqueName: "kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r") pod "network-check-target-mlmbw" (UID: "e7c26782-62b3-460a-b2ab-29c6db110c42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:32.237692 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:32.237661    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:32.237881 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:32.237708    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:32.237881 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:32.237806    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:32.237992 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:32.237960    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:33.236759 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:33.236725    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:33.237250 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:33.236867    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:34.237908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:34.237866    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:34.238393 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:34.237972    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:34.238393 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:34.238025    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:34.238393 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:34.238136    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:35.237461 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:35.237424    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:35.237630 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:35.237564    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:36.236770 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:36.236738    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:36.237209 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:36.236870    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:36.237209 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:36.236913    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:36.237209 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:36.236982    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:37.237181 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.236785    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:37.237869 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:37.237328    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:37.357272 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.357175    2566 generic.go:356] "Generic (PLEG): container finished" podID="0b901120-f94d-49bf-8098-cd196b635d7a" containerID="f0bf02fde07a56581fcd9059b4b120c24cb93ed198dbc286d79f96585ed64c97" exitCode=0
Jul 27 20:51:37.357473 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.357272    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerDied","Data":"f0bf02fde07a56581fcd9059b4b120c24cb93ed198dbc286d79f96585ed64c97"}
Jul 27 20:51:37.359084 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.359047    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7tnkz" event={"ID":"13bd8697-f1fe-44bc-a652-50a9903c07d5","Type":"ContainerStarted","Data":"6774b76670f6484675e04aa2a17f27f1cb6ef2475b66ccd6c23b409b82f2f47d"}
Jul 27 20:51:37.360832 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.360793    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8lj7n" event={"ID":"a7a5764f-13bb-42f3-8849-18b1e549631c","Type":"ContainerStarted","Data":"a5510a0c2f461faeb4b45b3c71ecdd7292139580902aa7489db5f5c6d2896d8d"}
Jul 27 20:51:37.362466 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.362440    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-72wr4" event={"ID":"251732b1-eb60-40ec-bf31-81a031ab1393","Type":"ContainerStarted","Data":"2c416ee547ae8a7e9f6beccf456475e14246b5d13374fdd1421a86eed7d2512b"}
Jul 27 20:51:37.365456 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.365429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j652r" event={"ID":"d45ae4f1-15ec-4d11-8576-767169e717af","Type":"ContainerStarted","Data":"fa1fad2f73795ee090ce5ce966b6cfa05a9dd19f76aa9a85e189de8d346af6e0"}
Jul 27 20:51:37.367028 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.367003    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x58zc" event={"ID":"6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5","Type":"ContainerStarted","Data":"b7c79e6ce863b16b24bd0ad9dd7d91aac1926d8fd3609f4f3dbea55fb9d489b7"}
Jul 27 20:51:37.370500 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.370474    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"18a6910cef7c737b9774dc714feb6494fcd130198199f43db25c8dc9ea56673c"}
Jul 27 20:51:37.370658 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.370587    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"336eae232f7d36e18eccb61c602aefb8442af8c703c08a5c94467982a88de689"}
Jul 27 20:51:37.370658 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.370639    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"2379fe3bb253a533def6fdf33788616681b4aef4424964f8b5e4e805cb062f29"}
Jul 27 20:51:37.370779 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.370685    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"6a08876feadac6de1bd2d5715011eb416a4de7b2bf25dcb96e38af145e41539d"}
Jul 27 20:51:37.370779 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.370734    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"f0f0b656ef2dcb78621adc2fc355a395c5143042f91bcfa1fc3a2d34722affd3"}
Jul 27 20:51:37.370878 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.370782    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"14acc9295670d3c3437e118d1b6646d53913ca6291455289e21500e52d804726"}
Jul 27 20:51:37.372100 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.372076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777" event={"ID":"b170b467-7f3d-4f59-9c72-b209db120b2b","Type":"ContainerStarted","Data":"0ffb922b9629731d4eb12c87f10c10add9b118a6141136dedd16fd4ffcb0e0fa"}
Jul 27 20:51:37.402506 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.402454    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-72wr4" podStartSLOduration=3.971711567 podStartE2EDuration="23.402433945s" totalImagesPullingTime="19.430722378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:37.402306286 +0000 UTC m=+23.698637619" watchObservedRunningTime="2026-07-27 20:51:37.402433945 +0000 UTC m=+23.698765262"
Jul 27 20:51:37.419883 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.419832    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j652r" podStartSLOduration=2.9901018539999997 podStartE2EDuration="22.419816035s" totalImagesPullingTime="19.429714181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:37.419608728 +0000 UTC m=+23.715940047" watchObservedRunningTime="2026-07-27 20:51:37.419816035 +0000 UTC m=+23.716147353"
Jul 27 20:51:37.436830 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.436771    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x58zc" podStartSLOduration=6.849299193 podStartE2EDuration="22.436751165s" totalImagesPullingTime="15.587451972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:37.436571704 +0000 UTC m=+23.732903020" watchObservedRunningTime="2026-07-27 20:51:37.436751165 +0000 UTC m=+23.733082488"
Jul 27 20:51:37.454808 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.454745    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8lj7n" podStartSLOduration=2.95371378 podStartE2EDuration="22.454722266s" totalImagesPullingTime="19.501008486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:37.454018417 +0000 UTC m=+23.750349735" watchObservedRunningTime="2026-07-27 20:51:37.454722266 +0000 UTC m=+23.751053587"
Jul 27 20:51:37.470928 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.470857    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7tnkz" podStartSLOduration=7.895448669 podStartE2EDuration="23.470838241s" totalImagesPullingTime="15.575389572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:37.470747088 +0000 UTC m=+23.767078406" watchObservedRunningTime="2026-07-27 20:51:37.470838241 +0000 UTC m=+23.767169560"
Jul 27 20:51:37.913865 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:37.913833    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:51:38.156762 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.156559    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:51:37.913858395Z","UUID":"9166e5d2-309b-4d5f-bfa9-9bd8b32f7b07","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:51:38.158958 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.158933    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:51:38.159093 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.158978    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:51:38.238885 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.238853    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:38.239336 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:38.238975    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:38.239388 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.239353    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:38.239480 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:38.239448    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:38.376874 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.376838    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777" event={"ID":"b170b467-7f3d-4f59-9c72-b209db120b2b","Type":"ContainerStarted","Data":"e3a5afd0955b9714f667acde46bcca1a0cd66c1a41b6cd70f82d6214513fb315"}
Jul 27 20:51:38.378923 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.378886    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzmhn" event={"ID":"fe0c1c74-f51d-413e-bc62-28ccc3e3ab96","Type":"ContainerStarted","Data":"899b264ed3d7475bd1b1c61f50567a49a4276f9dae6427980d57bca8fef243b6"}
Jul 27 20:51:38.395886 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:38.395821    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nzmhn" podStartSLOduration=3.976821755 podStartE2EDuration="23.395804637s" totalImagesPullingTime="19.418982882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:38.395240273 +0000 UTC m=+24.691571595" watchObservedRunningTime="2026-07-27 20:51:38.395804637 +0000 UTC m=+24.692135954"
Jul 27 20:51:39.237371 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:39.237325    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:39.237596 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:39.237480    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:39.385609 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:39.385574    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"63a1a3e1413252cb13a9d8142e3f3d5a616e9508abf805ee23d48325cb63592c"}
Jul 27 20:51:39.388741 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:39.388713    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777" event={"ID":"b170b467-7f3d-4f59-9c72-b209db120b2b","Type":"ContainerStarted","Data":"fae3cafd19aa9487b4923d97297e3f3dd5c5f2bba297e1aa672d9e5e89a7704e"}
Jul 27 20:51:39.406957 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:39.406893    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wn777" podStartSLOduration=2.683123869 podStartE2EDuration="24.406874519s" totalImagesPullingTime="21.72375065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:39.406715736 +0000 UTC m=+25.703047054" watchObservedRunningTime="2026-07-27 20:51:39.406874519 +0000 UTC m=+25.703205838"
Jul 27 20:51:40.237439 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:40.237389    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:40.237670 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:40.237389    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:40.237670 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:40.237565    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:40.237670 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:40.237599    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:40.424439 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:40.424397    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:40.425211 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:40.425181    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:41.237549 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:41.237319    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:41.237740 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:41.237685    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:42.237438 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.237397    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:42.238200 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:42.237522    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:42.238200 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.237587    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:42.238200 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:42.237682    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:42.398822 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.398785    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" event={"ID":"4691fc08-6485-4873-8d0c-5539ee22b0ab","Type":"ContainerStarted","Data":"6d06744550d8b7fd154fe11814c3e8cc124223098a3e27dffeea4529f5f77530"}
Jul 27 20:51:42.399073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.399049    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:42.399176 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.399129    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:42.400591 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.400569    2566 generic.go:356] "Generic (PLEG): container finished" podID="0b901120-f94d-49bf-8098-cd196b635d7a" containerID="9ea7ff152b0b5b9fdf9d20d76d41d37c1bfa7910afa9bcbb2a3141fadc59840d" exitCode=0
Jul 27 20:51:42.400674 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.400613    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerDied","Data":"9ea7ff152b0b5b9fdf9d20d76d41d37c1bfa7910afa9bcbb2a3141fadc59840d"}
Jul 27 20:51:42.416105 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.416072    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:42.430387 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:42.430334    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z" podStartSLOduration=7.932996602 podStartE2EDuration="27.43032046s" totalImagesPullingTime="19.497323858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:42.430146042 +0000 UTC m=+28.726477363" watchObservedRunningTime="2026-07-27 20:51:42.43032046 +0000 UTC m=+28.726651777"
Jul 27 20:51:43.237264 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.237231    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:43.237498 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:43.237361    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:43.403590 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.403562    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:43.420042 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.420013    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:51:43.988800 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.988764    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2zh7"]
Jul 27 20:51:43.988982 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.988960    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:43.989108 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:43.989079    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:43.989638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.989602    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n7r7v"]
Jul 27 20:51:43.989755 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.989713    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:43.989847 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:43.989804    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:43.992249 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.992215    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mlmbw"]
Jul 27 20:51:43.992360 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:43.992304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:43.992411 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:43.992377    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:44.407811 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:44.407779    2566 generic.go:356] "Generic (PLEG): container finished" podID="0b901120-f94d-49bf-8098-cd196b635d7a" containerID="cf22ae1ee5ff5d3bce86243bdc9dd8f53c582ffb3afb0de0aa7b23407ae9dfaa" exitCode=0
Jul 27 20:51:44.408296 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:44.407881    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerDied","Data":"cf22ae1ee5ff5d3bce86243bdc9dd8f53c582ffb3afb0de0aa7b23407ae9dfaa"}
Jul 27 20:51:45.032340 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:45.032308    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:45.032512 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:45.032426    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 27 20:51:45.032859 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:45.032846    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x58zc"
Jul 27 20:51:45.237467 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:45.237440    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:45.237661 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:45.237565    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:46.237136 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:46.236938    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:46.237650 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:46.237011    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:46.237650 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:46.237214    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:46.237650 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:46.237329    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:46.414755 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:46.414656    2566 generic.go:356] "Generic (PLEG): container finished" podID="0b901120-f94d-49bf-8098-cd196b635d7a" containerID="6cad7e78bf6d907f6ad9b24bff41c859553b658399ceef7c0ca7adad21d7a397" exitCode=0
Jul 27 20:51:46.414755 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:46.414721    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerDied","Data":"6cad7e78bf6d907f6ad9b24bff41c859553b658399ceef7c0ca7adad21d7a397"}
Jul 27 20:51:47.236774 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:47.236737    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:47.236936 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.236876    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:47.954546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:47.954445    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:47.954546 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:47.954506    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:47.954556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954644    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954655    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954699    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954717    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs podName:c1e263aa-bb6a-45c0-9cca-fcbf793f01a3 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:19.954695572 +0000 UTC m=+66.251026890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs") pod "network-metrics-daemon-n7r7v" (UID: "c1e263aa-bb6a-45c0-9cca-fcbf793f01a3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954724    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954736    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret podName:de21674c-cccb-4c0e-af96-c949e951b0d4 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:19.954726047 +0000 UTC m=+66.251057343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret") pod "global-pull-secret-syncer-q2zh7" (UID: "de21674c-cccb-4c0e-af96-c949e951b0d4") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954738    2566 projected.go:196] Error preparing data for projected volume kube-api-access-nc57r for pod openshift-network-diagnostics/network-check-target-mlmbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:47.955201 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:47.954833    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r podName:e7c26782-62b3-460a-b2ab-29c6db110c42 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:19.954816227 +0000 UTC m=+66.251147543 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nc57r" (UniqueName: "kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r") pod "network-check-target-mlmbw" (UID: "e7c26782-62b3-460a-b2ab-29c6db110c42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:51:48.241221 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:48.241180    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:48.241221 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:48.241218    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:48.241431 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:48.241218    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:48.241431 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:48.241312    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n7r7v" podUID="c1e263aa-bb6a-45c0-9cca-fcbf793f01a3"
Jul 27 20:51:48.241431 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:48.241409    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2zh7" podUID="de21674c-cccb-4c0e-af96-c949e951b0d4"
Jul 27 20:51:48.241566 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:48.241497    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mlmbw" podUID="e7c26782-62b3-460a-b2ab-29c6db110c42"
Jul 27 20:51:49.505687 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.505658    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-50.ec2.internal" event="NodeReady"
Jul 27 20:51:49.506149 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.505812    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:51:49.585719 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.585680    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6w65b"]
Jul 27 20:51:49.588322 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.588294    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5csbs"]
Jul 27 20:51:49.588474 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.588435    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.590326 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.590306    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:49.591939 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.591917    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:51:49.592447 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.592428    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qj4g\""
Jul 27 20:51:49.592685 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.592669    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:51:49.593074 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:49.593043    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 27 20:51:49.593381 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:49.593352    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 27 20:51:49.593474 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:49.593375    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"canary-serving-cert\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret"
Jul 27 20:51:49.607434 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:49.607375    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-cgmf5\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cgmf5\"" type="*v1.Secret"
Jul 27 20:51:49.608617 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.608591    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5csbs"]
Jul 27 20:51:49.609106 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.609084    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6w65b"]
Jul 27 20:51:49.667938 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.667901    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldckz\" (UniqueName: \"kubernetes.io/projected/626400fd-a7c4-443c-9ced-94c2b1302ed3-kube-api-access-ldckz\") pod \"ingress-canary-5csbs\" (UID: \"626400fd-a7c4-443c-9ced-94c2b1302ed3\") " pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:49.667938 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.667936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l527t\" (UniqueName: \"kubernetes.io/projected/109f9738-5bb9-4746-99d9-46a79be61ead-kube-api-access-l527t\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.668147 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.667960    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/626400fd-a7c4-443c-9ced-94c2b1302ed3-cert\") pod \"ingress-canary-5csbs\" (UID: \"626400fd-a7c4-443c-9ced-94c2b1302ed3\") " pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:49.668147 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.667979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/109f9738-5bb9-4746-99d9-46a79be61ead-tmp-dir\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.668147 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.668037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/109f9738-5bb9-4746-99d9-46a79be61ead-config-volume\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.668147 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.668051    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.769442 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.769356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldckz\" (UniqueName: \"kubernetes.io/projected/626400fd-a7c4-443c-9ced-94c2b1302ed3-kube-api-access-ldckz\") pod \"ingress-canary-5csbs\" (UID: \"626400fd-a7c4-443c-9ced-94c2b1302ed3\") " pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:49.769442 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.769401    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l527t\" (UniqueName: \"kubernetes.io/projected/109f9738-5bb9-4746-99d9-46a79be61ead-kube-api-access-l527t\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.769442 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.769438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/626400fd-a7c4-443c-9ced-94c2b1302ed3-cert\") pod \"ingress-canary-5csbs\" (UID: \"626400fd-a7c4-443c-9ced-94c2b1302ed3\") " pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:49.769768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.769464    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/109f9738-5bb9-4746-99d9-46a79be61ead-tmp-dir\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.769768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.769516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/109f9738-5bb9-4746-99d9-46a79be61ead-config-volume\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.769768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.769553    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.769768 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:49.769665    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:49.769768 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:49.769716    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls podName:109f9738-5bb9-4746-99d9-46a79be61ead nodeName:}" failed. No retries permitted until 2026-07-27 20:51:50.269698639 +0000 UTC m=+36.566029936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls") pod "dns-default-6w65b" (UID: "109f9738-5bb9-4746-99d9-46a79be61ead") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:49.770064 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.770037    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/109f9738-5bb9-4746-99d9-46a79be61ead-tmp-dir\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.770292 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.770267    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/109f9738-5bb9-4746-99d9-46a79be61ead-config-volume\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:49.781235 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:49.781199    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l527t\" (UniqueName: \"kubernetes.io/projected/109f9738-5bb9-4746-99d9-46a79be61ead-kube-api-access-l527t\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:50.237328 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.237292    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:51:50.237510 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.237335    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:51:50.237510 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.237292    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:51:50.241656 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.241444    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:51:50.241656 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.241461    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:51:50.241656 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.241494    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:51:50.241656 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.241513    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6wczd\""
Jul 27 20:51:50.241656 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.241561    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:51:50.241656 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.241461    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2w5wq\""
Jul 27 20:51:50.274261 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.274234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:50.274454 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:50.274374    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:50.274454 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:50.274445    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls podName:109f9738-5bb9-4746-99d9-46a79be61ead nodeName:}" failed. No retries permitted until 2026-07-27 20:51:51.274425081 +0000 UTC m=+37.570756392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls") pod "dns-default-6w65b" (UID: "109f9738-5bb9-4746-99d9-46a79be61ead") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:50.536413 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.536387    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:51:50.616021 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.615985    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:51:50.619547 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.619511    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldckz\" (UniqueName: \"kubernetes.io/projected/626400fd-a7c4-443c-9ced-94c2b1302ed3-kube-api-access-ldckz\") pod \"ingress-canary-5csbs\" (UID: \"626400fd-a7c4-443c-9ced-94c2b1302ed3\") " pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:50.770038 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:50.769932    2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: failed to sync secret cache: timed out waiting for the condition
Jul 27 20:51:50.770038 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:50.770038    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/626400fd-a7c4-443c-9ced-94c2b1302ed3-cert podName:626400fd-a7c4-443c-9ced-94c2b1302ed3 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:51.270016111 +0000 UTC m=+37.566347407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/626400fd-a7c4-443c-9ced-94c2b1302ed3-cert") pod "ingress-canary-5csbs" (UID: "626400fd-a7c4-443c-9ced-94c2b1302ed3") : failed to sync secret cache: timed out waiting for the condition
Jul 27 20:51:50.894498 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:50.894465    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cgmf5\""
Jul 27 20:51:51.157612 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.157473    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:51:51.282727 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.282673    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/626400fd-a7c4-443c-9ced-94c2b1302ed3-cert\") pod \"ingress-canary-5csbs\" (UID: \"626400fd-a7c4-443c-9ced-94c2b1302ed3\") " pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:51.282907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.282748    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:51.282907 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:51.282837    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:51.282907 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:51.282891    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls podName:109f9738-5bb9-4746-99d9-46a79be61ead nodeName:}" failed. No retries permitted until 2026-07-27 20:51:53.282875525 +0000 UTC m=+39.579206820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls") pod "dns-default-6w65b" (UID: "109f9738-5bb9-4746-99d9-46a79be61ead") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:51.285305 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.285287    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/626400fd-a7c4-443c-9ced-94c2b1302ed3-cert\") pod \"ingress-canary-5csbs\" (UID: \"626400fd-a7c4-443c-9ced-94c2b1302ed3\") " pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:51.407031 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.406974    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5csbs"
Jul 27 20:51:51.430951 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.430920    2566 generic.go:356] "Generic (PLEG): container finished" podID="0b901120-f94d-49bf-8098-cd196b635d7a" containerID="0462fbabe77501f51ea4265d094c69258e2d8db9a88df7d3e9546756d136cbe6" exitCode=0
Jul 27 20:51:51.431088 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.430963    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerDied","Data":"0462fbabe77501f51ea4265d094c69258e2d8db9a88df7d3e9546756d136cbe6"}
Jul 27 20:51:51.569668 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:51.569343    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5csbs"]
Jul 27 20:51:51.614435 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:51.614404    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626400fd_a7c4_443c_9ced_94c2b1302ed3.slice/crio-b0a7d67b69cfdd2ed80f07884b6fea3370cf2b889bf83f4304b63ea0968d9e01 WatchSource:0}: Error finding container b0a7d67b69cfdd2ed80f07884b6fea3370cf2b889bf83f4304b63ea0968d9e01: Status 404 returned error can't find the container with id b0a7d67b69cfdd2ed80f07884b6fea3370cf2b889bf83f4304b63ea0968d9e01
Jul 27 20:51:52.438088 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:52.438049    2566 generic.go:356] "Generic (PLEG): container finished" podID="0b901120-f94d-49bf-8098-cd196b635d7a" containerID="ff466d416dd8b96755da27e5ee74661239dca3e884f4588778ea2deb344e4e77" exitCode=0
Jul 27 20:51:52.438292 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:52.438159    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerDied","Data":"ff466d416dd8b96755da27e5ee74661239dca3e884f4588778ea2deb344e4e77"}
Jul 27 20:51:52.439989 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:52.439593    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5csbs" event={"ID":"626400fd-a7c4-443c-9ced-94c2b1302ed3","Type":"ContainerStarted","Data":"b0a7d67b69cfdd2ed80f07884b6fea3370cf2b889bf83f4304b63ea0968d9e01"}
Jul 27 20:51:53.299998 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:53.299960    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:53.300472 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:53.300143    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:53.300472 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:53.300215    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls podName:109f9738-5bb9-4746-99d9-46a79be61ead nodeName:}" failed. No retries permitted until 2026-07-27 20:51:57.300193192 +0000 UTC m=+43.596524488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls") pod "dns-default-6w65b" (UID: "109f9738-5bb9-4746-99d9-46a79be61ead") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:53.447104 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:53.446998    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" event={"ID":"0b901120-f94d-49bf-8098-cd196b635d7a","Type":"ContainerStarted","Data":"0ae23f810a3c6a85e7ac216d3a307b3c63a8c6325ce02893233f00af8f4f169a"}
Jul 27 20:51:53.473399 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:53.473331    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c8pcm" podStartSLOduration=8.48543325 podStartE2EDuration="38.473312552s" totalImagesPullingTime="29.987879302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:53.471932391 +0000 UTC m=+39.768263709" watchObservedRunningTime="2026-07-27 20:51:53.473312552 +0000 UTC m=+39.769643870"
Jul 27 20:51:54.073998 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.073811    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"]
Jul 27 20:51:54.088015 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.087977    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-7rqb6"]
Jul 27 20:51:54.088194 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.088123    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.090956 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.090928    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:51:54.091109 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.090929    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 20:51:54.091109 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.090928    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 20:51:54.091109 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.090965    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 20:51:54.091372 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.091357    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tkcv4\""
Jul 27 20:51:54.102317 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.102292    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"]
Jul 27 20:51:54.102442 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.102330    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-7rqb6"]
Jul 27 20:51:54.102442 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.102413    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.105465 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.105441    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 20:51:54.105465 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.105453    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hmbgt\""
Jul 27 20:51:54.105645 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.105431    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 20:51:54.105645 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.105479    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 20:51:54.105835 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.105813    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 20:51:54.114421 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.114398    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 20:51:54.194855 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.194823    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"]
Jul 27 20:51:54.209469 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209438    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d445e555-f3e6-446b-b8cc-0f2f75019637-snapshots\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.209469 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209480    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7xpb\" (UniqueName: \"kubernetes.io/projected/d445e555-f3e6-446b-b8cc-0f2f75019637-kube-api-access-c7xpb\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.209729 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e6ad5f3-23f4-44fd-a874-1b9313fad533-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.209729 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209632    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d445e555-f3e6-446b-b8cc-0f2f75019637-service-ca-bundle\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.209729 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209663    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d445e555-f3e6-446b-b8cc-0f2f75019637-serving-cert\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.209729 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209697    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vfmf\" (UniqueName: \"kubernetes.io/projected/2e6ad5f3-23f4-44fd-a874-1b9313fad533-kube-api-access-6vfmf\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.209729 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209719    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d445e555-f3e6-446b-b8cc-0f2f75019637-tmp\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.209908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209777    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ad5f3-23f4-44fd-a874-1b9313fad533-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.209908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.209802    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d445e555-f3e6-446b-b8cc-0f2f75019637-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.215407 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.215376    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"]
Jul 27 20:51:54.215554 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.215490    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.218056 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.218032    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 20:51:54.218225 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.218148    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 20:51:54.218225 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.218155    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zg9qz\""
Jul 27 20:51:54.218785 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.218756    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 20:51:54.219032 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.219016    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 20:51:54.284409 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.284377    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8557dccd86-cdj7r"]
Jul 27 20:51:54.298368 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.298337    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7dfcf8dbf5-2qk2g"]
Jul 27 20:51:54.298519 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.298464    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.306927 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.306898    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 20:51:54.307415 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.307029    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 20:51:54.307415 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.307152    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 20:51:54.307506 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.307490    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xqs7p\""
Jul 27 20:51:54.310200 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310171    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.310335 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ad5f3-23f4-44fd-a874-1b9313fad533-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.310335 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d445e555-f3e6-446b-b8cc-0f2f75019637-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.310335 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310323    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d445e555-f3e6-446b-b8cc-0f2f75019637-snapshots\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.310513 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xpb\" (UniqueName: \"kubernetes.io/projected/d445e555-f3e6-446b-b8cc-0f2f75019637-kube-api-access-c7xpb\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.310513 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310433    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/01b19404-7d81-4a66-8720-5e202c95078c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.310513 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310462    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7vm5\" (UniqueName: \"kubernetes.io/projected/01b19404-7d81-4a66-8720-5e202c95078c-kube-api-access-t7vm5\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.310513 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e6ad5f3-23f4-44fd-a874-1b9313fad533-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.310697 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310560    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d445e555-f3e6-446b-b8cc-0f2f75019637-service-ca-bundle\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.310697 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d445e555-f3e6-446b-b8cc-0f2f75019637-serving-cert\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.310697 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310640    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vfmf\" (UniqueName: \"kubernetes.io/projected/2e6ad5f3-23f4-44fd-a874-1b9313fad533-kube-api-access-6vfmf\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.310697 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.310666    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d445e555-f3e6-446b-b8cc-0f2f75019637-tmp\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.311032 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.311004    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d445e555-f3e6-446b-b8cc-0f2f75019637-tmp\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.311864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.311377    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d445e555-f3e6-446b-b8cc-0f2f75019637-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.311864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.311608    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d445e555-f3e6-446b-b8cc-0f2f75019637-snapshots\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.311864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.311714    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e6ad5f3-23f4-44fd-a874-1b9313fad533-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.314161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.313180    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d445e555-f3e6-446b-b8cc-0f2f75019637-service-ca-bundle\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.314161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.313773    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8557dccd86-cdj7r"]
Jul 27 20:51:54.314161 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.313922    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.318096 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.317844    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dfcf8dbf5-2qk2g"]
Jul 27 20:51:54.318096 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.317919    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 20:51:54.318464 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.318441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e6ad5f3-23f4-44fd-a874-1b9313fad533-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.320078 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.318949    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 20:51:54.320078 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.318975    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x8lcw\""
Jul 27 20:51:54.320078 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.319282    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 20:51:54.320078 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.319319    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 20:51:54.320078 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.319439    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 20:51:54.320864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.320846    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 20:51:54.321135 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.321113    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 20:51:54.321252 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.321234    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d445e555-f3e6-446b-b8cc-0f2f75019637-serving-cert\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.331430 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.331402    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vfmf\" (UniqueName: \"kubernetes.io/projected/2e6ad5f3-23f4-44fd-a874-1b9313fad533-kube-api-access-6vfmf\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x\" (UID: \"2e6ad5f3-23f4-44fd-a874-1b9313fad533\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.341650 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.341623    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xpb\" (UniqueName: \"kubernetes.io/projected/d445e555-f3e6-446b-b8cc-0f2f75019637-kube-api-access-c7xpb\") pod \"insights-operator-5885fdb759-7rqb6\" (UID: \"d445e555-f3e6-446b-b8cc-0f2f75019637\") " pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.387259 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.387227    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-drwv8"]
Jul 27 20:51:54.398457 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.398350    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"
Jul 27 20:51:54.407700 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.407675    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-drwv8"]
Jul 27 20:51:54.407817 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.407791    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.410695 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.410675    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 20:51:54.410994 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.410969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-bound-sa-token\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411103 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411016    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-stats-auth\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.411103 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v8xt\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-kube-api-access-8v8xt\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411126    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-trusted-ca\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411153    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.411254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-image-registry-private-configuration\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411257    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 20:51:54.411254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411265    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411302    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411346    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-plnsh\""
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411253    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d36484f2-3cae-4853-b5cf-c33e630416f2-ca-trust-extracted\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljddt\" (UniqueName: \"kubernetes.io/projected/9ef9bc58-faac-4b38-a236-44cf12a4708f-kube-api-access-ljddt\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411438    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-installation-pull-secrets\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411559    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/01b19404-7d81-4a66-8720-5e202c95078c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-certificates\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411615    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7vm5\" (UniqueName: \"kubernetes.io/projected/01b19404-7d81-4a66-8720-5e202c95078c-kube-api-access-t7vm5\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411655    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411679    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-default-certificate\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.411749 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.411749    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.412422 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.411877    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:54.412422 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.411964    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls podName:01b19404-7d81-4a66-8720-5e202c95078c nodeName:}" failed. No retries permitted until 2026-07-27 20:51:54.911944002 +0000 UTC m=+41.208275315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d6wg8" (UID: "01b19404-7d81-4a66-8720-5e202c95078c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:54.412422 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.412287    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/01b19404-7d81-4a66-8720-5e202c95078c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.415362 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.415343    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-7rqb6"
Jul 27 20:51:54.417229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.417212    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 20:51:54.422726 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.422705    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7vm5\" (UniqueName: \"kubernetes.io/projected/01b19404-7d81-4a66-8720-5e202c95078c-kube-api-access-t7vm5\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513086    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-bound-sa-token\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513132    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-stats-auth\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/880360ca-b783-4ce8-bad4-c16921652ffe-trusted-ca\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v8xt\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-kube-api-access-8v8xt\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513231    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/880360ca-b783-4ce8-bad4-c16921652ffe-config\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513260    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-trusted-ca\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513313    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-image-registry-private-configuration\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513343    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d36484f2-3cae-4853-b5cf-c33e630416f2-ca-trust-extracted\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513365    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljddt\" (UniqueName: \"kubernetes.io/projected/9ef9bc58-faac-4b38-a236-44cf12a4708f-kube-api-access-ljddt\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513407    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-installation-pull-secrets\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513457    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-certificates\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/880360ca-b783-4ce8-bad4-c16921652ffe-serving-cert\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513579    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59r4x\" (UniqueName: \"kubernetes.io/projected/880360ca-b783-4ce8-bad4-c16921652ffe-kube-api-access-59r4x\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513615    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.514185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513636    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.516908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.513671    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-default-certificate\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.516908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.514508    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-trusted-ca\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.517153 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.517126    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:51:55.017103853 +0000 UTC m=+41.313435173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.518929    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-certificates\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.519105    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.519125    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557dccd86-cdj7r: secret "image-registry-tls" not found
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.519167    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls podName:d36484f2-3cae-4853-b5cf-c33e630416f2 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:55.019153013 +0000 UTC m=+41.315484312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls") pod "image-registry-8557dccd86-cdj7r" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2") : secret "image-registry-tls" not found
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.519221    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d36484f2-3cae-4853-b5cf-c33e630416f2-ca-trust-extracted\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.519235    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.519273    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:51:55.019260637 +0000 UTC m=+41.315591932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : secret "router-metrics-certs-default" not found
Jul 27 20:51:54.520100 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.520037    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-default-certificate\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.521201 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.521059    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-image-registry-private-configuration\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.522604 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.522336    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-stats-auth\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.522604 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.522559    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-installation-pull-secrets\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.524565 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.524481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-bound-sa-token\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.526992 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.526972    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v8xt\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-kube-api-access-8v8xt\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:54.528197 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.528174    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljddt\" (UniqueName: \"kubernetes.io/projected/9ef9bc58-faac-4b38-a236-44cf12a4708f-kube-api-access-ljddt\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:54.566421 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.566346    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x"]
Jul 27 20:51:54.571371 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:54.571330    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6ad5f3_23f4_44fd_a874_1b9313fad533.slice/crio-fcf2ad1a1f4cc38845143e5658ccbec4550058557cf0ba3468c0f07f93651e70 WatchSource:0}: Error finding container fcf2ad1a1f4cc38845143e5658ccbec4550058557cf0ba3468c0f07f93651e70: Status 404 returned error can't find the container with id fcf2ad1a1f4cc38845143e5658ccbec4550058557cf0ba3468c0f07f93651e70
Jul 27 20:51:54.597750 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.597636    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-7rqb6"]
Jul 27 20:51:54.601119 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:54.601090    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd445e555_f3e6_446b_b8cc_0f2f75019637.slice/crio-3bb7d4e2febcab4ccb27f1d3fbe7cd515c2aa709c73564806ce865e7fa8088f3 WatchSource:0}: Error finding container 3bb7d4e2febcab4ccb27f1d3fbe7cd515c2aa709c73564806ce865e7fa8088f3: Status 404 returned error can't find the container with id 3bb7d4e2febcab4ccb27f1d3fbe7cd515c2aa709c73564806ce865e7fa8088f3
Jul 27 20:51:54.614889 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.614855    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/880360ca-b783-4ce8-bad4-c16921652ffe-trusted-ca\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.615032 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.614915    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/880360ca-b783-4ce8-bad4-c16921652ffe-config\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.615291 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.615042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/880360ca-b783-4ce8-bad4-c16921652ffe-serving-cert\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.615404 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.615344    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59r4x\" (UniqueName: \"kubernetes.io/projected/880360ca-b783-4ce8-bad4-c16921652ffe-kube-api-access-59r4x\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.615732 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.615712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/880360ca-b783-4ce8-bad4-c16921652ffe-config\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.616307 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.616283    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/880360ca-b783-4ce8-bad4-c16921652ffe-trusted-ca\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.618204 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.618186    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/880360ca-b783-4ce8-bad4-c16921652ffe-serving-cert\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.624557 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.624510    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59r4x\" (UniqueName: \"kubernetes.io/projected/880360ca-b783-4ce8-bad4-c16921652ffe-kube-api-access-59r4x\") pod \"console-operator-584dcb6b54-drwv8\" (UID: \"880360ca-b783-4ce8-bad4-c16921652ffe\") " pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.733033 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.732992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:51:54.906773 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.906741    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-drwv8"]
Jul 27 20:51:54.909432 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:51:54.909407    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880360ca_b783_4ce8_bad4_c16921652ffe.slice/crio-400be11c56123a130b4febf908f456d007154b2cec65d6a1c0533b1910d50903 WatchSource:0}: Error finding container 400be11c56123a130b4febf908f456d007154b2cec65d6a1c0533b1910d50903: Status 404 returned error can't find the container with id 400be11c56123a130b4febf908f456d007154b2cec65d6a1c0533b1910d50903
Jul 27 20:51:54.917970 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:54.917944    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:54.918100 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.918083    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:54.918174 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:54.918164    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls podName:01b19404-7d81-4a66-8720-5e202c95078c nodeName:}" failed. No retries permitted until 2026-07-27 20:51:55.918147521 +0000 UTC m=+42.214478817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d6wg8" (UID: "01b19404-7d81-4a66-8720-5e202c95078c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:55.019059 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.019018    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:55.019230 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.019195    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:51:56.019176407 +0000 UTC m=+42.315507703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:51:55.120207 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.120122    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:55.120207 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.120157    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:55.120384 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.120278    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:55.120384 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.120295    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557dccd86-cdj7r: secret "image-registry-tls" not found
Jul 27 20:51:55.120384 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.120334    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:51:55.120384 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.120352    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls podName:d36484f2-3cae-4853-b5cf-c33e630416f2 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:56.120335901 +0000 UTC m=+42.416667197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls") pod "image-registry-8557dccd86-cdj7r" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2") : secret "image-registry-tls" not found
Jul 27 20:51:55.120384 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.120383    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:51:56.120369614 +0000 UTC m=+42.416700911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : secret "router-metrics-certs-default" not found
Jul 27 20:51:55.453565 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.453456    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x" event={"ID":"2e6ad5f3-23f4-44fd-a874-1b9313fad533","Type":"ContainerStarted","Data":"fcf2ad1a1f4cc38845143e5658ccbec4550058557cf0ba3468c0f07f93651e70"}
Jul 27 20:51:55.455563 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.455508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" event={"ID":"880360ca-b783-4ce8-bad4-c16921652ffe","Type":"ContainerStarted","Data":"400be11c56123a130b4febf908f456d007154b2cec65d6a1c0533b1910d50903"}
Jul 27 20:51:55.458205 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.458135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5csbs" event={"ID":"626400fd-a7c4-443c-9ced-94c2b1302ed3","Type":"ContainerStarted","Data":"d9998069c4a727189c4be433153962fbd305f71e201cf8dcb30053bccd50074d"}
Jul 27 20:51:55.459503 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.459479    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7rqb6" event={"ID":"d445e555-f3e6-446b-b8cc-0f2f75019637","Type":"ContainerStarted","Data":"3bb7d4e2febcab4ccb27f1d3fbe7cd515c2aa709c73564806ce865e7fa8088f3"}
Jul 27 20:51:55.476045 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.475980    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5csbs" podStartSLOduration=3.717845401 podStartE2EDuration="6.475957752s" totalImagesPullingTime="2.758112351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:55.474327591 +0000 UTC m=+41.770658909" watchObservedRunningTime="2026-07-27 20:51:55.475957752 +0000 UTC m=+41.772289074"
Jul 27 20:51:55.928984 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:55.928938    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:55.929183 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.929126    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:55.929231 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:55.929219    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls podName:01b19404-7d81-4a66-8720-5e202c95078c nodeName:}" failed. No retries permitted until 2026-07-27 20:51:57.929200193 +0000 UTC m=+44.225531493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d6wg8" (UID: "01b19404-7d81-4a66-8720-5e202c95078c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:56.029742 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:56.029699    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:56.029921 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:56.029907    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:51:58.02988514 +0000 UTC m=+44.326216441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:51:56.131048 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:56.131008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:56.131218 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:56.131057    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:56.131218 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:56.131137    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:56.131218 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:56.131155    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557dccd86-cdj7r: secret "image-registry-tls" not found
Jul 27 20:51:56.131218 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:56.131218    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls podName:d36484f2-3cae-4853-b5cf-c33e630416f2 nodeName:}" failed. No retries permitted until 2026-07-27 20:51:58.131200296 +0000 UTC m=+44.427531614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls") pod "image-registry-8557dccd86-cdj7r" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2") : secret "image-registry-tls" not found
Jul 27 20:51:56.131375 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:56.131228    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:51:56.131375 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:56.131301    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:51:58.131280472 +0000 UTC m=+44.427611787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : secret "router-metrics-certs-default" not found
Jul 27 20:51:57.343931 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:57.343888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:51:57.344317 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:57.344025    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:51:57.344317 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:57.344083    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls podName:109f9738-5bb9-4746-99d9-46a79be61ead nodeName:}" failed. No retries permitted until 2026-07-27 20:52:05.344068007 +0000 UTC m=+51.640399324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls") pod "dns-default-6w65b" (UID: "109f9738-5bb9-4746-99d9-46a79be61ead") : secret "dns-default-metrics-tls" not found
Jul 27 20:51:57.947916 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:57.947865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:51:57.948115 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:57.947989    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:57.948115 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:57.948073    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls podName:01b19404-7d81-4a66-8720-5e202c95078c nodeName:}" failed. No retries permitted until 2026-07-27 20:52:01.948050286 +0000 UTC m=+48.244381592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d6wg8" (UID: "01b19404-7d81-4a66-8720-5e202c95078c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:51:58.048858 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:58.048815    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:58.049056 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:58.049022    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:52:02.049001732 +0000 UTC m=+48.345333055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:51:58.150313 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:58.150276    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:51:58.150313 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:58.150318    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:51:58.150524 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:58.150418    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:51:58.150524 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:58.150465    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:51:58.150524 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:58.150484    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:52:02.150470181 +0000 UTC m=+48.446801477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : secret "router-metrics-certs-default" not found
Jul 27 20:51:58.150524 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:58.150489    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557dccd86-cdj7r: secret "image-registry-tls" not found
Jul 27 20:51:58.150681 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:51:58.150551    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls podName:d36484f2-3cae-4853-b5cf-c33e630416f2 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:02.15051946 +0000 UTC m=+48.446850759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls") pod "image-registry-8557dccd86-cdj7r" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2") : secret "image-registry-tls" not found
Jul 27 20:51:59.471390 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.471343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7rqb6" event={"ID":"d445e555-f3e6-446b-b8cc-0f2f75019637","Type":"ContainerStarted","Data":"14ca7ef76ada2df315814d0a705bc95275e1916696771012fb26d851ef9836ae"}
Jul 27 20:51:59.473018 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.472991    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x" event={"ID":"2e6ad5f3-23f4-44fd-a874-1b9313fad533","Type":"ContainerStarted","Data":"42b45707dbccb799eaa220f15953cae2227da13ff936da02ebc49326d0756fec"}
Jul 27 20:51:59.474638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.474620    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/0.log"
Jul 27 20:51:59.474752 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.474651    2566 generic.go:356] "Generic (PLEG): container finished" podID="880360ca-b783-4ce8-bad4-c16921652ffe" containerID="8546bef383ebbe1d790ff1affe35582dc0507aaba0f3280f76d4ab357ad3e3d2" exitCode=255
Jul 27 20:51:59.474752 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.474679    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" event={"ID":"880360ca-b783-4ce8-bad4-c16921652ffe","Type":"ContainerDied","Data":"8546bef383ebbe1d790ff1affe35582dc0507aaba0f3280f76d4ab357ad3e3d2"}
Jul 27 20:51:59.474928 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.474910    2566 scope.go:117] "RemoveContainer" containerID="8546bef383ebbe1d790ff1affe35582dc0507aaba0f3280f76d4ab357ad3e3d2"
Jul 27 20:51:59.491752 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.491702    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-7rqb6" podStartSLOduration=1.5409787929999998 podStartE2EDuration="5.491679268s" totalImagesPullingTime="3.950700475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:59.489757088 +0000 UTC m=+45.786088440" watchObservedRunningTime="2026-07-27 20:51:59.491679268 +0000 UTC m=+45.788010587"
Jul 27 20:51:59.510168 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:51:59.509970    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x" podStartSLOduration=1.530957315 podStartE2EDuration="5.50994743s" totalImagesPullingTime="3.978990115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:51:59.5091814 +0000 UTC m=+45.805512718" watchObservedRunningTime="2026-07-27 20:51:59.50994743 +0000 UTC m=+45.806278749"
Jul 27 20:52:00.124420 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.124378    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zdmkv"]
Jul 27 20:52:00.140483 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.140298    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.141950 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.141920    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zdmkv"]
Jul 27 20:52:00.144852 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.144827    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 20:52:00.144983 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.144866    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 20:52:00.146128 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.146086    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwd8q\""
Jul 27 20:52:00.267670 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.267630    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.267857 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.267710    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.267916 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.267838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01bd2105-a14a-427d-8cf6-a7b356114fbc-data-volume\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.267916 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.267900    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llg6h\" (UniqueName: \"kubernetes.io/projected/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-api-access-llg6h\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.268037 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.268018    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01bd2105-a14a-427d-8cf6-a7b356114fbc-crio-socket\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.368854 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.368801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.369057 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.368893    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01bd2105-a14a-427d-8cf6-a7b356114fbc-data-volume\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.369057 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.368933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llg6h\" (UniqueName: \"kubernetes.io/projected/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-api-access-llg6h\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.369057 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.368966    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:00.369057 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.369003    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01bd2105-a14a-427d-8cf6-a7b356114fbc-crio-socket\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.369057 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.369045    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:00.869026748 +0000 UTC m=+47.165358047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:00.369343 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.369099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.369343 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.369203    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:00.369343 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.369221    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01bd2105-a14a-427d-8cf6-a7b356114fbc-crio-socket\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.369343 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.369277    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01bd2105-a14a-427d-8cf6-a7b356114fbc-data-volume\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.369343 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.369285    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:00.869266141 +0000 UTC m=+47.165597451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:00.379967 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.379888    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llg6h\" (UniqueName: \"kubernetes.io/projected/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-api-access-llg6h\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.478777 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.478745    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 20:52:00.479182 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.479166    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/0.log"
Jul 27 20:52:00.479230 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.479203    2566 generic.go:356] "Generic (PLEG): container finished" podID="880360ca-b783-4ce8-bad4-c16921652ffe" containerID="5c5ab17204c9fc300952d9bd263744e605b8694ebf45249f474ac8f7113f1feb" exitCode=255
Jul 27 20:52:00.479267 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.479232    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" event={"ID":"880360ca-b783-4ce8-bad4-c16921652ffe","Type":"ContainerDied","Data":"5c5ab17204c9fc300952d9bd263744e605b8694ebf45249f474ac8f7113f1feb"}
Jul 27 20:52:00.479303 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.479289    2566 scope.go:117] "RemoveContainer" containerID="8546bef383ebbe1d790ff1affe35582dc0507aaba0f3280f76d4ab357ad3e3d2"
Jul 27 20:52:00.479580 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.479563    2566 scope.go:117] "RemoveContainer" containerID="5c5ab17204c9fc300952d9bd263744e605b8694ebf45249f474ac8f7113f1feb"
Jul 27 20:52:00.479780 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.479761    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-drwv8_openshift-console-operator(880360ca-b783-4ce8-bad4-c16921652ffe)\"" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" podUID="880360ca-b783-4ce8-bad4-c16921652ffe"
Jul 27 20:52:00.874228 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.874179    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.874424 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:00.874239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:00.874424 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.874331    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:00.874424 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.874384    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:00.874424 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.874407    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:01.874389701 +0000 UTC m=+48.170720997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:00.874424 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:00.874424    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:01.874412802 +0000 UTC m=+48.170744098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:01.482714 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:01.482687    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 20:52:01.483064 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:01.483025    2566 scope.go:117] "RemoveContainer" containerID="5c5ab17204c9fc300952d9bd263744e605b8694ebf45249f474ac8f7113f1feb"
Jul 27 20:52:01.483190 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:01.483171    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-drwv8_openshift-console-operator(880360ca-b783-4ce8-bad4-c16921652ffe)\"" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" podUID="880360ca-b783-4ce8-bad4-c16921652ffe"
Jul 27 20:52:01.882049 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:01.882008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:01.882265 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:01.882167    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:01.882265 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:01.882172    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:01.882387 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:01.882270    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 20:52:01.882387 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:01.882301    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:03.882281784 +0000 UTC m=+50.178613100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:01.882387 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:01.882325    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:03.882310344 +0000 UTC m=+50.178641643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : configmap "kube-rbac-proxy" not found
Jul 27 20:52:01.902747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:01.902713    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7tnkz_13bd8697-f1fe-44bc-a652-50a9903c07d5/dns-node-resolver/0.log"
Jul 27 20:52:01.982670 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:01.982629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:52:01.982818 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:01.982778    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:01.982867 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:01.982849    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls podName:01b19404-7d81-4a66-8720-5e202c95078c nodeName:}" failed. No retries permitted until 2026-07-27 20:52:09.98283267 +0000 UTC m=+56.279163968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d6wg8" (UID: "01b19404-7d81-4a66-8720-5e202c95078c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:02.084058 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:02.084016    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:02.084234 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:02.084186    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:52:10.08416811 +0000 UTC m=+56.380499406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:52:02.185398 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:02.185288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:02.185398 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:02.185333    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:02.185653 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:02.185452    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:52:02.185653 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:02.185465    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 20:52:02.185653 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:02.185486    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557dccd86-cdj7r: secret "image-registry-tls" not found
Jul 27 20:52:02.185653 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:02.185519    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:52:10.185501001 +0000 UTC m=+56.481832297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : secret "router-metrics-certs-default" not found
Jul 27 20:52:02.185653 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:02.185561    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls podName:d36484f2-3cae-4853-b5cf-c33e630416f2 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:10.185530197 +0000 UTC m=+56.481861495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls") pod "image-registry-8557dccd86-cdj7r" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2") : secret "image-registry-tls" not found
Jul 27 20:52:02.902315 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:02.902284    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-72wr4_251732b1-eb60-40ec-bf31-81a031ab1393/node-ca/0.log"
Jul 27 20:52:03.703256 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:03.703216    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5csbs_626400fd-a7c4-443c-9ced-94c2b1302ed3/serve-healthcheck-canary/0.log"
Jul 27 20:52:03.899524 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:03.899486    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:03.899748 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:03.899628    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:03.899748 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:03.899658    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:03.899748 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:03.899740    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:07.899719242 +0000 UTC m=+54.196050557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:03.900110 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:03.900090    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01bd2105-a14a-427d-8cf6-a7b356114fbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:04.733296 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:04.733257    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:52:04.733725 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:04.733318    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:52:04.733725 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:04.733682    2566 scope.go:117] "RemoveContainer" containerID="5c5ab17204c9fc300952d9bd263744e605b8694ebf45249f474ac8f7113f1feb"
Jul 27 20:52:04.733854 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:04.733834    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-drwv8_openshift-console-operator(880360ca-b783-4ce8-bad4-c16921652ffe)\"" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" podUID="880360ca-b783-4ce8-bad4-c16921652ffe"
Jul 27 20:52:05.411560 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:05.411494    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:52:05.411775 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:05.411656    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:52:05.411775 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:05.411735    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls podName:109f9738-5bb9-4746-99d9-46a79be61ead nodeName:}" failed. No retries permitted until 2026-07-27 20:52:21.41171441 +0000 UTC m=+67.708045710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls") pod "dns-default-6w65b" (UID: "109f9738-5bb9-4746-99d9-46a79be61ead") : secret "dns-default-metrics-tls" not found
Jul 27 20:52:07.929498 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:07.929446    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:07.929996 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:07.929629    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:07.929996 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:07.929714    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls podName:01bd2105-a14a-427d-8cf6-a7b356114fbc nodeName:}" failed. No retries permitted until 2026-07-27 20:52:15.929696771 +0000 UTC m=+62.226028067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zdmkv" (UID: "01bd2105-a14a-427d-8cf6-a7b356114fbc") : secret "insights-runtime-extractor-tls" not found
Jul 27 20:52:10.045667 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:10.045627    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:52:10.046151 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:10.045792    2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:10.046151 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:10.045866    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls podName:01b19404-7d81-4a66-8720-5e202c95078c nodeName:}" failed. No retries permitted until 2026-07-27 20:52:26.045848943 +0000 UTC m=+72.342180244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d6wg8" (UID: "01b19404-7d81-4a66-8720-5e202c95078c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 20:52:10.146922 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:10.146878    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:10.147051 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:10.147028    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:52:26.147014005 +0000 UTC m=+72.443345301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : configmap references non-existent config key: service-ca.crt
Jul 27 20:52:10.248104 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:10.248069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:10.248104 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:10.248104    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:10.248281 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:10.248224    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 20:52:10.248314 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:10.248282    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs podName:9ef9bc58-faac-4b38-a236-44cf12a4708f nodeName:}" failed. No retries permitted until 2026-07-27 20:52:26.248264023 +0000 UTC m=+72.544595320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs") pod "router-default-7dfcf8dbf5-2qk2g" (UID: "9ef9bc58-faac-4b38-a236-44cf12a4708f") : secret "router-metrics-certs-default" not found
Jul 27 20:52:10.250783 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:10.250739    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"image-registry-8557dccd86-cdj7r\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") " pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:10.507061 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:10.507036    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:10.657737 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:10.657706    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8557dccd86-cdj7r"]
Jul 27 20:52:10.660625 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:10.660599    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36484f2_3cae_4853_b5cf_c33e630416f2.slice/crio-17922763b9e2fd37b7a2f624041de47ce01c8f4ef8ab2769083c1b4671541694 WatchSource:0}: Error finding container 17922763b9e2fd37b7a2f624041de47ce01c8f4ef8ab2769083c1b4671541694: Status 404 returned error can't find the container with id 17922763b9e2fd37b7a2f624041de47ce01c8f4ef8ab2769083c1b4671541694
Jul 27 20:52:11.508718 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:11.508675    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r" event={"ID":"d36484f2-3cae-4853-b5cf-c33e630416f2","Type":"ContainerStarted","Data":"1dee74b2fd3f6cb620dba832cd3b3c99d7f7584c9660ddfce026f130f52e5987"}
Jul 27 20:52:11.509091 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:11.508733    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r" event={"ID":"d36484f2-3cae-4853-b5cf-c33e630416f2","Type":"ContainerStarted","Data":"17922763b9e2fd37b7a2f624041de47ce01c8f4ef8ab2769083c1b4671541694"}
Jul 27 20:52:11.509091 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:11.508759    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:11.529384 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:11.529332    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r" podStartSLOduration=17.529313629 podStartE2EDuration="17.529313629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:11.528100277 +0000 UTC m=+57.824431597" watchObservedRunningTime="2026-07-27 20:52:11.529313629 +0000 UTC m=+57.825644947"
Jul 27 20:52:15.428916 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:15.428885    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zks2z"
Jul 27 20:52:15.994791 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:15.994749    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:15.997177 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:15.997149    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01bd2105-a14a-427d-8cf6-a7b356114fbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zdmkv\" (UID: \"01bd2105-a14a-427d-8cf6-a7b356114fbc\") " pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:16.054224 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.054192    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwd8q\""
Jul 27 20:52:16.061739 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.061704    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zdmkv"
Jul 27 20:52:16.192483 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.192332    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zdmkv"]
Jul 27 20:52:16.195127 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:16.195105    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01bd2105_a14a_427d_8cf6_a7b356114fbc.slice/crio-e520fabab70ae2104f7333054e130881818931c6209e86951f25761de21c1ef0 WatchSource:0}: Error finding container e520fabab70ae2104f7333054e130881818931c6209e86951f25761de21c1ef0: Status 404 returned error can't find the container with id e520fabab70ae2104f7333054e130881818931c6209e86951f25761de21c1ef0
Jul 27 20:52:16.237385 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.237355    2566 scope.go:117] "RemoveContainer" containerID="5c5ab17204c9fc300952d9bd263744e605b8694ebf45249f474ac8f7113f1feb"
Jul 27 20:52:16.523561 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.523437    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdmkv" event={"ID":"01bd2105-a14a-427d-8cf6-a7b356114fbc","Type":"ContainerStarted","Data":"e520fabab70ae2104f7333054e130881818931c6209e86951f25761de21c1ef0"}
Jul 27 20:52:16.525324 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.525302    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 20:52:16.525433 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.525367    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" event={"ID":"880360ca-b783-4ce8-bad4-c16921652ffe","Type":"ContainerStarted","Data":"ede22512921fd5d090e93cb63dfa1f1d52d7c2a5c4f0ffb28e4f8cdde577de91"}
Jul 27 20:52:16.525661 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.525641    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:52:16.545283 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:16.545228    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8" podStartSLOduration=18.897626107 podStartE2EDuration="22.545212499s" totalImagesPullingTime="3.647586392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:16.54451054 +0000 UTC m=+62.840841871" watchObservedRunningTime="2026-07-27 20:52:16.545212499 +0000 UTC m=+62.841543818"
Jul 27 20:52:17.120950 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:17.120912    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-drwv8"
Jul 27 20:52:20.036723 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.036682    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:52:20.037259 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.036763    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:52:20.037259 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.036805    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:52:20.039782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.039742    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:52:20.040925 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.040902    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:52:20.041060 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.040926    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:52:20.049800 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.049760    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de21674c-cccb-4c0e-af96-c949e951b0d4-original-pull-secret\") pod \"global-pull-secret-syncer-q2zh7\" (UID: \"de21674c-cccb-4c0e-af96-c949e951b0d4\") " pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:52:20.049927 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.049760    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1e263aa-bb6a-45c0-9cca-fcbf793f01a3-metrics-certs\") pod \"network-metrics-daemon-n7r7v\" (UID: \"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3\") " pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:52:20.049996 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.049981    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:52:20.060364 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.060338    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/e7c26782-62b3-460a-b2ab-29c6db110c42-kube-api-access-nc57r\") pod \"network-check-target-mlmbw\" (UID: \"e7c26782-62b3-460a-b2ab-29c6db110c42\") " pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:52:20.253060 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.253022    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2w5wq\""
Jul 27 20:52:20.257118 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.257094    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2zh7"
Jul 27 20:52:20.261215 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.261187    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n7r7v"
Jul 27 20:52:20.266331 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.266308    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6wczd\""
Jul 27 20:52:20.273658 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:20.273632    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:52:21.373882 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.373851    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2zh7"]
Jul 27 20:52:21.377251 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:21.377208    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde21674c_cccb_4c0e_af96_c949e951b0d4.slice/crio-e0d5307f4eae7ee6d385f2945d50836a061cff72b7337f5a30aa90c53ff5ee48 WatchSource:0}: Error finding container e0d5307f4eae7ee6d385f2945d50836a061cff72b7337f5a30aa90c53ff5ee48: Status 404 returned error can't find the container with id e0d5307f4eae7ee6d385f2945d50836a061cff72b7337f5a30aa90c53ff5ee48
Jul 27 20:52:21.448197 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.448164    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:52:21.450616 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.450596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/109f9738-5bb9-4746-99d9-46a79be61ead-metrics-tls\") pod \"dns-default-6w65b\" (UID: \"109f9738-5bb9-4746-99d9-46a79be61ead\") " pod="openshift-dns/dns-default-6w65b"
Jul 27 20:52:21.542904 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.542870    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2zh7" event={"ID":"de21674c-cccb-4c0e-af96-c949e951b0d4","Type":"ContainerStarted","Data":"e0d5307f4eae7ee6d385f2945d50836a061cff72b7337f5a30aa90c53ff5ee48"}
Jul 27 20:52:21.598598 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.598569    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mlmbw"]
Jul 27 20:52:21.601281 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:21.601253    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c26782_62b3_460a_b2ab_29c6db110c42.slice/crio-1f9f13c9f1ec29acfbb48bd61b6cf469d5b0ccd41ccbb36a932baf7126093069 WatchSource:0}: Error finding container 1f9f13c9f1ec29acfbb48bd61b6cf469d5b0ccd41ccbb36a932baf7126093069: Status 404 returned error can't find the container with id 1f9f13c9f1ec29acfbb48bd61b6cf469d5b0ccd41ccbb36a932baf7126093069
Jul 27 20:52:21.602242 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.602219    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n7r7v"]
Jul 27 20:52:21.605813 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:21.605782    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e263aa_bb6a_45c0_9cca_fcbf793f01a3.slice/crio-ce2a34db13a1009338d518f9177297ec667a969d97d8e4d3d012ae84cfe4464c WatchSource:0}: Error finding container ce2a34db13a1009338d518f9177297ec667a969d97d8e4d3d012ae84cfe4464c: Status 404 returned error can't find the container with id ce2a34db13a1009338d518f9177297ec667a969d97d8e4d3d012ae84cfe4464c
Jul 27 20:52:21.703460 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.703430    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qj4g\""
Jul 27 20:52:21.710835 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.710794    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6w65b"
Jul 27 20:52:21.861609 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:21.861498    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6w65b"]
Jul 27 20:52:21.864458 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:21.864423    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109f9738_5bb9_4746_99d9_46a79be61ead.slice/crio-d01d859cd395570019d9648f03d4f8ae9e329ce5d3a0cbdc3660c660c069bdf0 WatchSource:0}: Error finding container d01d859cd395570019d9648f03d4f8ae9e329ce5d3a0cbdc3660c660c069bdf0: Status 404 returned error can't find the container with id d01d859cd395570019d9648f03d4f8ae9e329ce5d3a0cbdc3660c660c069bdf0
Jul 27 20:52:22.549951 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:22.549912    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdmkv" event={"ID":"01bd2105-a14a-427d-8cf6-a7b356114fbc","Type":"ContainerStarted","Data":"a48111e2633a23741d5ebec5c71a84369dfcd9514b50a1fc42fb50a431a84c6a"}
Jul 27 20:52:22.551870 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:22.551806    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6w65b" event={"ID":"109f9738-5bb9-4746-99d9-46a79be61ead","Type":"ContainerStarted","Data":"d01d859cd395570019d9648f03d4f8ae9e329ce5d3a0cbdc3660c660c069bdf0"}
Jul 27 20:52:22.553685 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:22.553655    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n7r7v" event={"ID":"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3","Type":"ContainerStarted","Data":"ce2a34db13a1009338d518f9177297ec667a969d97d8e4d3d012ae84cfe4464c"}
Jul 27 20:52:22.555317 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:22.555289    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mlmbw" event={"ID":"e7c26782-62b3-460a-b2ab-29c6db110c42","Type":"ContainerStarted","Data":"1f9f13c9f1ec29acfbb48bd61b6cf469d5b0ccd41ccbb36a932baf7126093069"}
Jul 27 20:52:23.564060 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:23.563877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n7r7v" event={"ID":"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3","Type":"ContainerStarted","Data":"7336b6f565f19ebd2a959f6721f726b5e202335bfa8a7bd34546c0c48ff73598"}
Jul 27 20:52:23.564060 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:23.563993    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n7r7v" event={"ID":"c1e263aa-bb6a-45c0-9cca-fcbf793f01a3","Type":"ContainerStarted","Data":"2dd48e9f704ef31d7b1140ba1b1f2075a07aeb3a520a3dcfc050bf8d0dc7e454"}
Jul 27 20:52:23.586373 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:23.586307    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n7r7v" podStartSLOduration=66.995782351 podStartE2EDuration="1m8.586285073s" totalImagesPullingTime="1.590502722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:23.585648017 +0000 UTC m=+69.881979399" watchObservedRunningTime="2026-07-27 20:52:23.586285073 +0000 UTC m=+69.882616399"
Jul 27 20:52:24.014815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.014042    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8557dccd86-cdj7r"]
Jul 27 20:52:24.063203 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.062364    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-s57tl"]
Jul 27 20:52:24.065207 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.064481    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-s57tl"
Jul 27 20:52:24.068732 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.068032    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 20:52:24.068732 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.068285    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-726kn\""
Jul 27 20:52:24.068732 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.068620    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 20:52:24.093690 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.093654    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-s57tl"]
Jul 27 20:52:24.116407 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.116344    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78f8898599-mhm9t"]
Jul 27 20:52:24.118615 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.118591    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.143155 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.143120    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f8898599-mhm9t"]
Jul 27 20:52:24.173634 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173594    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-registry-certificates\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173646    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-bound-sa-token\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-installation-pull-secrets\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173708    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-registry-tls\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jspvr\" (UniqueName: \"kubernetes.io/projected/5e5b7643-5d9b-454f-a70c-16078e079785-kube-api-access-jspvr\") pod \"downloads-7c97dc4555-s57tl\" (UID: \"5e5b7643-5d9b-454f-a70c-16078e079785\") " pod="openshift-console/downloads-7c97dc4555-s57tl"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-ca-trust-extracted\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173775    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52s7m\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-kube-api-access-52s7m\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-image-registry-private-configuration\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.173815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.173820    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-trusted-ca\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274444 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274303    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-registry-certificates\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274614 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-bound-sa-token\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274614 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274504    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-installation-pull-secrets\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274614 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274560    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-registry-tls\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274614 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jspvr\" (UniqueName: \"kubernetes.io/projected/5e5b7643-5d9b-454f-a70c-16078e079785-kube-api-access-jspvr\") pod \"downloads-7c97dc4555-s57tl\" (UID: \"5e5b7643-5d9b-454f-a70c-16078e079785\") " pod="openshift-console/downloads-7c97dc4555-s57tl"
Jul 27 20:52:24.274778 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-ca-trust-extracted\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274778 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52s7m\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-kube-api-access-52s7m\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274778 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274666    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-image-registry-private-configuration\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.274778 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.274710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-trusted-ca\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.275132 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.275110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-registry-certificates\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.275522 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.275503    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-ca-trust-extracted\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.275675 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.275625    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-trusted-ca\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.279074 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.279043    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-registry-tls\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.279732 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.279685    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-image-registry-private-configuration\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.294255 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.288963    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-installation-pull-secrets\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.294255 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.292080    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52s7m\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-kube-api-access-52s7m\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.294255 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.292212    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jspvr\" (UniqueName: \"kubernetes.io/projected/5e5b7643-5d9b-454f-a70c-16078e079785-kube-api-access-jspvr\") pod \"downloads-7c97dc4555-s57tl\" (UID: \"5e5b7643-5d9b-454f-a70c-16078e079785\") " pod="openshift-console/downloads-7c97dc4555-s57tl"
Jul 27 20:52:24.294255 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.294229    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1eacdaf8-6bb6-4dec-88fe-7385b19861ad-bound-sa-token\") pod \"image-registry-78f8898599-mhm9t\" (UID: \"1eacdaf8-6bb6-4dec-88fe-7385b19861ad\") " pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:24.378345 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.378075    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-s57tl"
Jul 27 20:52:24.431407 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:24.431364    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:26.089006 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.088964    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:52:26.092215 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.092184    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01b19404-7d81-4a66-8720-5e202c95078c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d6wg8\" (UID: \"01b19404-7d81-4a66-8720-5e202c95078c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:52:26.189747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.189705    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:26.190490 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.190462    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ef9bc58-faac-4b38-a236-44cf12a4708f-service-ca-bundle\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:26.291259 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.291215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:26.294107 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.294075    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ef9bc58-faac-4b38-a236-44cf12a4708f-metrics-certs\") pod \"router-default-7dfcf8dbf5-2qk2g\" (UID: \"9ef9bc58-faac-4b38-a236-44cf12a4708f\") " pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:26.327522 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.327491    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zg9qz\""
Jul 27 20:52:26.335585 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.335549    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"
Jul 27 20:52:26.434760 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.434671    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x8lcw\""
Jul 27 20:52:26.443081 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:26.443043    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:29.306970 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.306933    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-s57tl"]
Jul 27 20:52:29.346018 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:29.345989    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5b7643_5d9b_454f_a70c_16078e079785.slice/crio-a7593860d162dd888322ca460e00ef5260444972c8e2b1a27884ac974948b50e WatchSource:0}: Error finding container a7593860d162dd888322ca460e00ef5260444972c8e2b1a27884ac974948b50e: Status 404 returned error can't find the container with id a7593860d162dd888322ca460e00ef5260444972c8e2b1a27884ac974948b50e
Jul 27 20:52:29.551570 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.551508    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f8898599-mhm9t"]
Jul 27 20:52:29.563797 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.563589    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8"]
Jul 27 20:52:29.586203 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.586175    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dfcf8dbf5-2qk2g"]
Jul 27 20:52:29.590864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.589800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6w65b" event={"ID":"109f9738-5bb9-4746-99d9-46a79be61ead","Type":"ContainerStarted","Data":"7a57e0fbf198991e9002268669c72e6edd6d9fc22bc7ac1795ecba5d4a3d0f09"}
Jul 27 20:52:29.591986 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.591952    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mlmbw" event={"ID":"e7c26782-62b3-460a-b2ab-29c6db110c42","Type":"ContainerStarted","Data":"185f5f6736a4c45459d9e4dc84738cf03fa819c2f4d20064fd2b0cfabb1bb97a"}
Jul 27 20:52:29.592109 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.592088    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:52:29.594158 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.594123    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2zh7" event={"ID":"de21674c-cccb-4c0e-af96-c949e951b0d4","Type":"ContainerStarted","Data":"151bef57c169162794d84d3aaf29ef44f650bf11148180dc0b39f10eaf4b5bd9"}
Jul 27 20:52:29.595107 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.595087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-s57tl" event={"ID":"5e5b7643-5d9b-454f-a70c-16078e079785","Type":"ContainerStarted","Data":"a7593860d162dd888322ca460e00ef5260444972c8e2b1a27884ac974948b50e"}
Jul 27 20:52:29.608921 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.608867    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mlmbw" podStartSLOduration=66.870898092 podStartE2EDuration="1m14.608850834s" totalImagesPullingTime="7.737952742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:29.607713208 +0000 UTC m=+75.904044526" watchObservedRunningTime="2026-07-27 20:52:29.608850834 +0000 UTC m=+75.905182151"
Jul 27 20:52:29.622622 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:29.622562    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q2zh7" podStartSLOduration=66.834953177 podStartE2EDuration="1m14.622528428s" totalImagesPullingTime="7.787575251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:29.622192486 +0000 UTC m=+75.918523805" watchObservedRunningTime="2026-07-27 20:52:29.622528428 +0000 UTC m=+75.918859723"
Jul 27 20:52:29.667472 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:29.667134    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef9bc58_faac_4b38_a236_44cf12a4708f.slice/crio-df199ff148dbc1cc44ec2b5af9ed7c92914a5f90f1ba28a299802ea72ffb5d40 WatchSource:0}: Error finding container df199ff148dbc1cc44ec2b5af9ed7c92914a5f90f1ba28a299802ea72ffb5d40: Status 404 returned error can't find the container with id df199ff148dbc1cc44ec2b5af9ed7c92914a5f90f1ba28a299802ea72ffb5d40
Jul 27 20:52:30.610230 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.610109    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdmkv" event={"ID":"01bd2105-a14a-427d-8cf6-a7b356114fbc","Type":"ContainerStarted","Data":"b3007d230ee9b6d30f24ccdb5e5e2b7a2063f969d9d2af9b9c478f899b5e5f52"}
Jul 27 20:52:30.615219 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.614114    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6w65b" event={"ID":"109f9738-5bb9-4746-99d9-46a79be61ead","Type":"ContainerStarted","Data":"52a220a507bb2dc27bdd383bc8060129ca033854d2eac89168892344b9daf342"}
Jul 27 20:52:30.615219 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.615151    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6w65b"
Jul 27 20:52:30.617665 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.617576    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8" event={"ID":"01b19404-7d81-4a66-8720-5e202c95078c","Type":"ContainerStarted","Data":"50a373def46a6b9c89f1a93ed396a9a2571b9b721faf3b30d1c67868efd63016"}
Jul 27 20:52:30.619754 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.619614    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f8898599-mhm9t" event={"ID":"1eacdaf8-6bb6-4dec-88fe-7385b19861ad","Type":"ContainerStarted","Data":"c90373c76420e30b5fe81e7a38df6ed1a104a522eb6074ddfebca535a8af83de"}
Jul 27 20:52:30.619754 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.619657    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f8898599-mhm9t" event={"ID":"1eacdaf8-6bb6-4dec-88fe-7385b19861ad","Type":"ContainerStarted","Data":"1e249da45a20476c244620e5527bb4190d763d20524a3091f90598fea304982a"}
Jul 27 20:52:30.619754 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.619726    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:30.622558 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.622021    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g" event={"ID":"9ef9bc58-faac-4b38-a236-44cf12a4708f","Type":"ContainerStarted","Data":"e593c2b2ce8118ec7c51d773c7af4dbccdcc340b81b33477ba6d56389bd960ea"}
Jul 27 20:52:30.622558 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.622058    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g" event={"ID":"9ef9bc58-faac-4b38-a236-44cf12a4708f","Type":"ContainerStarted","Data":"df199ff148dbc1cc44ec2b5af9ed7c92914a5f90f1ba28a299802ea72ffb5d40"}
Jul 27 20:52:30.635697 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.635563    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6w65b" podStartSLOduration=35.012590581 podStartE2EDuration="41.635520897s" totalImagesPullingTime="6.622930316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:30.633588926 +0000 UTC m=+76.929920246" watchObservedRunningTime="2026-07-27 20:52:30.635520897 +0000 UTC m=+76.931852215"
Jul 27 20:52:30.654737 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:30.654671    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g" podStartSLOduration=36.654647677 podStartE2EDuration="36.654647677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:30.65459264 +0000 UTC m=+76.950923963" watchObservedRunningTime="2026-07-27 20:52:30.654647677 +0000 UTC m=+76.950978997"
Jul 27 20:52:31.443912 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:31.443874    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:31.447203 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:31.447175    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:31.469576 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:31.469490    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78f8898599-mhm9t" podStartSLOduration=7.469469306 podStartE2EDuration="7.469469306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:30.676396196 +0000 UTC m=+76.972727526" watchObservedRunningTime="2026-07-27 20:52:31.469469306 +0000 UTC m=+77.765800628"
Jul 27 20:52:31.626102 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:31.626042    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:31.627959 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:31.627932    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7dfcf8dbf5-2qk2g"
Jul 27 20:52:32.621127 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.621093    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"]
Jul 27 20:52:32.623794 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.623766    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:32.626601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.626574    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 20:52:32.626968 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.626688    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sgj54\""
Jul 27 20:52:32.632834 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.632809    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8" event={"ID":"01b19404-7d81-4a66-8720-5e202c95078c","Type":"ContainerStarted","Data":"17d38b2c3cbc7b26327e9db1db344382fa86ebdc2bfaf7af700f33deae434c3a"}
Jul 27 20:52:32.636457 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.636305    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"]
Jul 27 20:52:32.755321 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.755281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62f303e8-c2bc-47c9-b421-89b833d6cc90-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-djj8d\" (UID: \"62f303e8-c2bc-47c9-b421-89b833d6cc90\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:32.856558 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:32.856501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62f303e8-c2bc-47c9-b421-89b833d6cc90-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-djj8d\" (UID: \"62f303e8-c2bc-47c9-b421-89b833d6cc90\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:32.856754 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:32.856677    2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 20:52:32.856815 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:32.856759    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f303e8-c2bc-47c9-b421-89b833d6cc90-tls-certificates podName:62f303e8-c2bc-47c9-b421-89b833d6cc90 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:33.356735224 +0000 UTC m=+79.653066523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/62f303e8-c2bc-47c9-b421-89b833d6cc90-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-djj8d" (UID: "62f303e8-c2bc-47c9-b421-89b833d6cc90") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 20:52:33.361556 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:33.361493    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62f303e8-c2bc-47c9-b421-89b833d6cc90-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-djj8d\" (UID: \"62f303e8-c2bc-47c9-b421-89b833d6cc90\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:33.364686 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:33.364651    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62f303e8-c2bc-47c9-b421-89b833d6cc90-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-djj8d\" (UID: \"62f303e8-c2bc-47c9-b421-89b833d6cc90\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:33.538136 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:33.538097    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:34.021023 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:34.020987    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:34.044772 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:34.044715    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d6wg8" podStartSLOduration=37.642549696 podStartE2EDuration="40.044699176s" totalImagesPullingTime="2.40214948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:32.670656102 +0000 UTC m=+78.966987422" watchObservedRunningTime="2026-07-27 20:52:34.044699176 +0000 UTC m=+80.341030501"
Jul 27 20:52:34.784803 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:34.784644    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"]
Jul 27 20:52:34.787784 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:34.787735    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f303e8_c2bc_47c9_b421_89b833d6cc90.slice/crio-f4c2bb1c06936fb5a1346655f0a3410a145c9a4d4776b8fe13436ba9d52e53fd WatchSource:0}: Error finding container f4c2bb1c06936fb5a1346655f0a3410a145c9a4d4776b8fe13436ba9d52e53fd: Status 404 returned error can't find the container with id f4c2bb1c06936fb5a1346655f0a3410a145c9a4d4776b8fe13436ba9d52e53fd
Jul 27 20:52:35.647737 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:35.647649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zdmkv" event={"ID":"01bd2105-a14a-427d-8cf6-a7b356114fbc","Type":"ContainerStarted","Data":"ac24bf01fdac5577092527f750ed61fafbc2086e8dca98e8cd23c093a95cad51"}
Jul 27 20:52:35.649528 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:35.649495    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d" event={"ID":"62f303e8-c2bc-47c9-b421-89b833d6cc90","Type":"ContainerStarted","Data":"f4c2bb1c06936fb5a1346655f0a3410a145c9a4d4776b8fe13436ba9d52e53fd"}
Jul 27 20:52:35.667986 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:35.667917    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zdmkv" podStartSLOduration=17.455827571 podStartE2EDuration="35.667893265s" totalImagesPullingTime="18.212065694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:52:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:35.666651675 +0000 UTC m=+81.962983010" watchObservedRunningTime="2026-07-27 20:52:35.667893265 +0000 UTC m=+81.964224584"
Jul 27 20:52:36.655457 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:36.655366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d" event={"ID":"62f303e8-c2bc-47c9-b421-89b833d6cc90","Type":"ContainerStarted","Data":"828177cd3cc618604ae54df0e68bceb647d5b07d1ef09ef853eab38a41dfd08f"}
Jul 27 20:52:36.655921 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:36.655852    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:36.661746 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:36.661715    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d"
Jul 27 20:52:36.675028 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:36.674978    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-djj8d" podStartSLOduration=3.191825516 podStartE2EDuration="4.674960713s" totalImagesPullingTime="1.483135197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:36.672610216 +0000 UTC m=+82.968941533" watchObservedRunningTime="2026-07-27 20:52:36.674960713 +0000 UTC m=+82.971292030"
Jul 27 20:52:41.635555 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:41.635513    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6w65b"
Jul 27 20:52:42.105826 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.105784    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"]
Jul 27 20:52:42.109131 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.109106    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.114601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.114335    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 20:52:42.114601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.114443    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mvc56\""
Jul 27 20:52:42.115868 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.115686    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 20:52:42.115868 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.115718    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 20:52:42.125443 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.125416    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"]
Jul 27 20:52:42.155413 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.155368    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"]
Jul 27 20:52:42.158023 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.157997    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.163015 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.162825    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 20:52:42.164019 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.163992    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 20:52:42.164843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.164307    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 20:52:42.164843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.164695    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b9fjz\""
Jul 27 20:52:42.166655 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.166615    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k42r7"]
Jul 27 20:52:42.171815 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.171794    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.174348 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.174317    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wfrq9\""
Jul 27 20:52:42.174348 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.174339    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 20:52:42.174516 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.174387    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 20:52:42.174516 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.174481    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 20:52:42.179156 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.179132    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"]
Jul 27 20:52:42.240666 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.240836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240674    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.240836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.240836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240761    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.240836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240804    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.241016 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240849    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.241016 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbpz\" (UniqueName: \"kubernetes.io/projected/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-api-access-9dbpz\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.241016 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.241016 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.240981    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.241147 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.241020    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2rt7\" (UniqueName: \"kubernetes.io/projected/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-kube-api-access-f2rt7\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.342415 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342376    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbpz\" (UniqueName: \"kubernetes.io/projected/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-api-access-9dbpz\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.342415 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342417    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.342711 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342711 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342509    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-accelerators-collector-config\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342711 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342596    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.342711 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:42.342615    2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 27 20:52:42.342711 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342624    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-sys\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342711 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342648    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde0b560-93eb-4219-b1f5-50687e33ee16-metrics-client-ca\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342711 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342687    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2rt7\" (UniqueName: \"kubernetes.io/projected/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-kube-api-access-f2rt7\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.342953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342717    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-tls\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342739    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-wtmp\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342765    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-textfile\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342810    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.342953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-root\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.342953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.342953 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.342942    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.343291 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.343018    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.343291 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:42.343053    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-tls podName:9b63e3e1-4c64-4d02-94b9-40c4835f3c74 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:42.843030037 +0000 UTC m=+89.139361337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-f8hbk" (UID: "9b63e3e1-4c64-4d02-94b9-40c4835f3c74") : secret "openshift-state-metrics-tls" not found
Jul 27 20:52:42.343291 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.343090    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.343291 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.343124    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v5rj\" (UniqueName: \"kubernetes.io/projected/dde0b560-93eb-4219-b1f5-50687e33ee16-kube-api-access-6v5rj\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.343291 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.343159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.343580 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:42.343303    2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 20:52:42.343580 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:42.343491    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-tls podName:9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:42.843351858 +0000 UTC m=+89.139683349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-f8zzh" (UID: "9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08") : secret "kube-state-metrics-tls" not found
Jul 27 20:52:42.343726 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.343683    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.343839 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.343786    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.343958 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.343930    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.344029 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.344004    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.345457 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.345431    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.346156 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.346132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.355399 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.355361    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2rt7\" (UniqueName: \"kubernetes.io/projected/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-kube-api-access-f2rt7\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.358337 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.358276    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbpz\" (UniqueName: \"kubernetes.io/projected/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-api-access-9dbpz\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.444410 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444371    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444410 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444426    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-accelerators-collector-config\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444462    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-sys\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde0b560-93eb-4219-b1f5-50687e33ee16-metrics-client-ca\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444520    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-tls\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444559    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-wtmp\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444577    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-textfile\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444612    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-root\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.444676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.444668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v5rj\" (UniqueName: \"kubernetes.io/projected/dde0b560-93eb-4219-b1f5-50687e33ee16-kube-api-access-6v5rj\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.445374 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:42.445342    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 20:52:42.445501 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.445405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-sys\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.445501 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:42.445418    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-tls podName:dde0b560-93eb-4219-b1f5-50687e33ee16 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:42.945398025 +0000 UTC m=+89.241729340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-tls") pod "node-exporter-k42r7" (UID: "dde0b560-93eb-4219-b1f5-50687e33ee16") : secret "node-exporter-tls" not found
Jul 27 20:52:42.445729 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.445703    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-textfile\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.445867 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.445850    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-wtmp\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.445944 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.445910    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dde0b560-93eb-4219-b1f5-50687e33ee16-root\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.446167 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.446151    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dde0b560-93eb-4219-b1f5-50687e33ee16-metrics-client-ca\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.446259 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.446224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-accelerators-collector-config\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.447855 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.447837    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.455977 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.455949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v5rj\" (UniqueName: \"kubernetes.io/projected/dde0b560-93eb-4219-b1f5-50687e33ee16-kube-api-access-6v5rj\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.849399 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.849366    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.849880 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.849430    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.852260 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.852224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b63e3e1-4c64-4d02-94b9-40c4835f3c74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f8hbk\" (UID: \"9b63e3e1-4c64-4d02-94b9-40c4835f3c74\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:42.852395 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.852276    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-f8zzh\" (UID: \"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:42.950829 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.950794    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-tls\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:42.953652 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:42.953620    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dde0b560-93eb-4219-b1f5-50687e33ee16-node-exporter-tls\") pod \"node-exporter-k42r7\" (UID: \"dde0b560-93eb-4219-b1f5-50687e33ee16\") " pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:43.020973 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:43.020934    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"
Jul 27 20:52:43.074793 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:43.074753    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"
Jul 27 20:52:43.084664 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:43.084636    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k42r7"
Jul 27 20:52:46.521853 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.521811    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6485545b46-8d7dz"]
Jul 27 20:52:46.668097 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.668058    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6485545b46-8d7dz"]
Jul 27 20:52:46.668293 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.668147    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.672254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.672226    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 20:52:46.672254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.672242    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 20:52:46.672513 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.672495    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 20:52:46.672758 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.672742    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 20:52:46.672891 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.672876    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ffurv1qg58ias\""
Jul 27 20:52:46.672995 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.672984    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h24gb\""
Jul 27 20:52:46.787493 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.787398    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-secret-metrics-server-tls\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.787493 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.787443    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc861518-73a7-40c0-9e3f-f33bab1929ba-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.787493 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.787469    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc861518-73a7-40c0-9e3f-f33bab1929ba-metrics-server-audit-profiles\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.787797 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.787654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-client-ca-bundle\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.787797 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.787696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc861518-73a7-40c0-9e3f-f33bab1929ba-audit-log\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.787797 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.787742    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zs74\" (UniqueName: \"kubernetes.io/projected/cc861518-73a7-40c0-9e3f-f33bab1929ba-kube-api-access-8zs74\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.787797 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.787773    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-secret-metrics-server-client-certs\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.887027 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.886989    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"]
Jul 27 20:52:46.888328 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888295    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-secret-metrics-server-client-certs\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.888477 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-secret-metrics-server-tls\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.888477 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc861518-73a7-40c0-9e3f-f33bab1929ba-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.888477 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888433    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc861518-73a7-40c0-9e3f-f33bab1929ba-metrics-server-audit-profiles\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.888638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888500    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-client-ca-bundle\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.888638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888523    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc861518-73a7-40c0-9e3f-f33bab1929ba-audit-log\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.888638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zs74\" (UniqueName: \"kubernetes.io/projected/cc861518-73a7-40c0-9e3f-f33bab1929ba-kube-api-access-8zs74\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.888967 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.888938    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc861518-73a7-40c0-9e3f-f33bab1929ba-audit-log\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.889377 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.889292    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc861518-73a7-40c0-9e3f-f33bab1929ba-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.889779 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.889725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc861518-73a7-40c0-9e3f-f33bab1929ba-metrics-server-audit-profiles\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.891411 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.891387    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-secret-metrics-server-client-certs\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.891511 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.891477    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-secret-metrics-server-tls\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.891998 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.891969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc861518-73a7-40c0-9e3f-f33bab1929ba-client-ca-bundle\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.906393 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.906365    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zs74\" (UniqueName: \"kubernetes.io/projected/cc861518-73a7-40c0-9e3f-f33bab1929ba-kube-api-access-8zs74\") pod \"metrics-server-6485545b46-8d7dz\" (UID: \"cc861518-73a7-40c0-9e3f-f33bab1929ba\") " pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:46.909923 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.909893    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"]
Jul 27 20:52:46.910054 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.910011    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:46.914498 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.914077    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 20:52:46.914498 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.914317    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2mjrv\""
Jul 27 20:52:46.934331 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.934301    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d5d4fd495-4px2f"]
Jul 27 20:52:46.951979 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.951949    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5d4fd495-4px2f"]
Jul 27 20:52:46.952144 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.952041    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:46.955044 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.955017    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 20:52:46.955206 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.955167    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 20:52:46.955206 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.955190    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 20:52:46.955354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.955291    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 20:52:46.955354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.955328    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j8rtq\""
Jul 27 20:52:46.956100 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.956074    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 20:52:46.960437 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.960415    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 20:52:46.979403 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:46.979368    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:52:47.090584 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090473    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-trusted-ca-bundle\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.090584 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090549    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-oauth-config\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.090584 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-config\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.090823 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090649    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt8cl\" (UniqueName: \"kubernetes.io/projected/b5fd59af-43f1-40aa-b33c-cf072a5f1712-kube-api-access-dt8cl\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.090823 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef3f02bd-7b18-48e3-bcee-466a8ec91038-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mp8t4\" (UID: \"ef3f02bd-7b18-48e3-bcee-466a8ec91038\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.090823 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090739    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-serving-cert\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.090823 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090762    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-service-ca\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.090823 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090798    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-oauth-serving-cert\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.091018 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.090827    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t4jw\" (UniqueName: \"kubernetes.io/projected/ef3f02bd-7b18-48e3-bcee-466a8ec91038-kube-api-access-7t4jw\") pod \"monitoring-plugin-68b7fc9574-mp8t4\" (UID: \"ef3f02bd-7b18-48e3-bcee-466a8ec91038\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.191792 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.191751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-trusted-ca-bundle\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.191988 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.191811    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-oauth-config\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.191988 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.191839    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-config\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.191988 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.191878    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt8cl\" (UniqueName: \"kubernetes.io/projected/b5fd59af-43f1-40aa-b33c-cf072a5f1712-kube-api-access-dt8cl\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.191988 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.191902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef3f02bd-7b18-48e3-bcee-466a8ec91038-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mp8t4\" (UID: \"ef3f02bd-7b18-48e3-bcee-466a8ec91038\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.191988 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.191949    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-serving-cert\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.191988 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.191974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-service-ca\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.192255 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.192017    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-oauth-serving-cert\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.192255 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.192052    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t4jw\" (UniqueName: \"kubernetes.io/projected/ef3f02bd-7b18-48e3-bcee-466a8ec91038-kube-api-access-7t4jw\") pod \"monitoring-plugin-68b7fc9574-mp8t4\" (UID: \"ef3f02bd-7b18-48e3-bcee-466a8ec91038\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.192703 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:47.192679    2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 20:52:47.192821 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:52:47.192764    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef3f02bd-7b18-48e3-bcee-466a8ec91038-monitoring-plugin-cert podName:ef3f02bd-7b18-48e3-bcee-466a8ec91038 nodeName:}" failed. No retries permitted until 2026-07-27 20:52:47.692738415 +0000 UTC m=+93.989069711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ef3f02bd-7b18-48e3-bcee-466a8ec91038-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-mp8t4" (UID: "ef3f02bd-7b18-48e3-bcee-466a8ec91038") : secret "monitoring-plugin-cert" not found
Jul 27 20:52:47.192890 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.192841    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-trusted-ca-bundle\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.193144 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.193104    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-config\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.193355 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.193218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-service-ca\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.193525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.193401    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-oauth-serving-cert\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.195584 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.195523    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-oauth-config\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.195584 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.195553    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-serving-cert\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.203908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.203874    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t4jw\" (UniqueName: \"kubernetes.io/projected/ef3f02bd-7b18-48e3-bcee-466a8ec91038-kube-api-access-7t4jw\") pod \"monitoring-plugin-68b7fc9574-mp8t4\" (UID: \"ef3f02bd-7b18-48e3-bcee-466a8ec91038\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.205152 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.204946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt8cl\" (UniqueName: \"kubernetes.io/projected/b5fd59af-43f1-40aa-b33c-cf072a5f1712-kube-api-access-dt8cl\") pod \"console-d5d4fd495-4px2f\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") " pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.264878 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.264844    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:52:47.553013 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:47.552968    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde0b560_93eb_4219_b1f5_50687e33ee16.slice/crio-98c25863fda98b00cf534bf2d293b335b1ed7fa9362986cc68f0d6f62a0b2eaf WatchSource:0}: Error finding container 98c25863fda98b00cf534bf2d293b335b1ed7fa9362986cc68f0d6f62a0b2eaf: Status 404 returned error can't find the container with id 98c25863fda98b00cf534bf2d293b335b1ed7fa9362986cc68f0d6f62a0b2eaf
Jul 27 20:52:47.698424 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.698387    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef3f02bd-7b18-48e3-bcee-466a8ec91038-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mp8t4\" (UID: \"ef3f02bd-7b18-48e3-bcee-466a8ec91038\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.701336 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.701308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef3f02bd-7b18-48e3-bcee-466a8ec91038-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mp8t4\" (UID: \"ef3f02bd-7b18-48e3-bcee-466a8ec91038\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.702018 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.701984    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k42r7" event={"ID":"dde0b560-93eb-4219-b1f5-50687e33ee16","Type":"ContainerStarted","Data":"98c25863fda98b00cf534bf2d293b335b1ed7fa9362986cc68f0d6f62a0b2eaf"}
Jul 27 20:52:47.729986 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.729954    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6485545b46-8d7dz"]
Jul 27 20:52:47.791620 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.791596    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh"]
Jul 27 20:52:47.826107 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.826032    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:47.871484 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:47.871443    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc861518_73a7_40c0_9e3f_f33bab1929ba.slice/crio-4b02bec1e9a2744a4dd55623fef9e7485d17f35b043cbd2e733fb2590fde903e WatchSource:0}: Error finding container 4b02bec1e9a2744a4dd55623fef9e7485d17f35b043cbd2e733fb2590fde903e: Status 404 returned error can't find the container with id 4b02bec1e9a2744a4dd55623fef9e7485d17f35b043cbd2e733fb2590fde903e
Jul 27 20:52:47.872130 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:47.872103    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb3a37f_b7bb_4fef_a1dd_e42460b7ee08.slice/crio-180b7cbe77d0c1941d6e9a3c84a146867667e4a190d1ee8e9e2fb9b824c00f2d WatchSource:0}: Error finding container 180b7cbe77d0c1941d6e9a3c84a146867667e4a190d1ee8e9e2fb9b824c00f2d: Status 404 returned error can't find the container with id 180b7cbe77d0c1941d6e9a3c84a146867667e4a190d1ee8e9e2fb9b824c00f2d
Jul 27 20:52:47.962762 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.962667    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5d4fd495-4px2f"]
Jul 27 20:52:47.967690 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:47.967520    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5fd59af_43f1_40aa_b33c_cf072a5f1712.slice/crio-f1d5f84351c30c063d89b6bc6cc819fc48e717627db43dc08d2eb962e5febd8e WatchSource:0}: Error finding container f1d5f84351c30c063d89b6bc6cc819fc48e717627db43dc08d2eb962e5febd8e: Status 404 returned error can't find the container with id f1d5f84351c30c063d89b6bc6cc819fc48e717627db43dc08d2eb962e5febd8e
Jul 27 20:52:47.968036 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:47.967978    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk"]
Jul 27 20:52:47.972329 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:52:47.972297    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b63e3e1_4c64_4d02_94b9_40c4835f3c74.slice/crio-56db1f36c95aa43938e19b3006bfe27ed9fd2985824287c00da09a454df6621a WatchSource:0}: Error finding container 56db1f36c95aa43938e19b3006bfe27ed9fd2985824287c00da09a454df6621a: Status 404 returned error can't find the container with id 56db1f36c95aa43938e19b3006bfe27ed9fd2985824287c00da09a454df6621a
Jul 27 20:52:48.078969 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.078300    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"]
Jul 27 20:52:48.708937 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.708782    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-s57tl" event={"ID":"5e5b7643-5d9b-454f-a70c-16078e079785","Type":"ContainerStarted","Data":"1615edf680b687ebfb54e9eab90a9fc12f501e2dbb6cb3cdd81b0204d895b8db"}
Jul 27 20:52:48.709785 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.709728    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-s57tl"
Jul 27 20:52:48.713522 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.713492    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh" event={"ID":"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08","Type":"ContainerStarted","Data":"180b7cbe77d0c1941d6e9a3c84a146867667e4a190d1ee8e9e2fb9b824c00f2d"}
Jul 27 20:52:48.716525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.716455    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4" event={"ID":"ef3f02bd-7b18-48e3-bcee-466a8ec91038","Type":"ContainerStarted","Data":"f909bb6efd955a46556e2dc0ded53eef52bc0429a7406107c11b4292cc300c4c"}
Jul 27 20:52:48.719775 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.719745    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk" event={"ID":"9b63e3e1-4c64-4d02-94b9-40c4835f3c74","Type":"ContainerStarted","Data":"3ef81d01fbd8f74d1bd758df393c551f8c7f9fe4ae7892822b4a458c7879422d"}
Jul 27 20:52:48.719964 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.719801    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk" event={"ID":"9b63e3e1-4c64-4d02-94b9-40c4835f3c74","Type":"ContainerStarted","Data":"515f739d2cddee115d74aa1f641b3142a3925bcda641fe67e9706b4767c36ecf"}
Jul 27 20:52:48.719964 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.719842    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk" event={"ID":"9b63e3e1-4c64-4d02-94b9-40c4835f3c74","Type":"ContainerStarted","Data":"56db1f36c95aa43938e19b3006bfe27ed9fd2985824287c00da09a454df6621a"}
Jul 27 20:52:48.725952 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.725735    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-s57tl"
Jul 27 20:52:48.725952 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.725894    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz" event={"ID":"cc861518-73a7-40c0-9e3f-f33bab1929ba","Type":"ContainerStarted","Data":"4b02bec1e9a2744a4dd55623fef9e7485d17f35b043cbd2e733fb2590fde903e"}
Jul 27 20:52:48.728744 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.728712    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d4fd495-4px2f" event={"ID":"b5fd59af-43f1-40aa-b33c-cf072a5f1712","Type":"ContainerStarted","Data":"f1d5f84351c30c063d89b6bc6cc819fc48e717627db43dc08d2eb962e5febd8e"}
Jul 27 20:52:48.732791 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:48.732743    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-s57tl" podStartSLOduration=6.106901423 podStartE2EDuration="24.732724078s" totalImagesPullingTime="18.625822655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:48.730853347 +0000 UTC m=+95.027184667" watchObservedRunningTime="2026-07-27 20:52:48.732724078 +0000 UTC m=+95.029055399"
Jul 27 20:52:49.054679 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:49.054403    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r" podUID="d36484f2-3cae-4853-b5cf-c33e630416f2" containerName="registry" containerID="cri-o://1dee74b2fd3f6cb620dba832cd3b3c99d7f7584c9660ddfce026f130f52e5987" gracePeriod=30
Jul 27 20:52:49.743078 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:49.743034    2566 generic.go:356] "Generic (PLEG): container finished" podID="d36484f2-3cae-4853-b5cf-c33e630416f2" containerID="1dee74b2fd3f6cb620dba832cd3b3c99d7f7584c9660ddfce026f130f52e5987" exitCode=0
Jul 27 20:52:49.743572 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:49.743170    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r" event={"ID":"d36484f2-3cae-4853-b5cf-c33e630416f2","Type":"ContainerDied","Data":"1dee74b2fd3f6cb620dba832cd3b3c99d7f7584c9660ddfce026f130f52e5987"}
Jul 27 20:52:49.749871 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:49.749832    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k42r7" event={"ID":"dde0b560-93eb-4219-b1f5-50687e33ee16","Type":"ContainerStarted","Data":"1f5d319aff12ad34c368738e5899f95b0e5a5bf2338154aef05a31895d2cf9c1"}
Jul 27 20:52:50.649623 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.649585    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:50.731965 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.731927    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-trusted-ca\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732151 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732068    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-image-registry-private-configuration\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732151 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732122    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-installation-pull-secrets\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732270 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732160    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-certificates\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732270 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732207    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732270 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732265    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v8xt\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-kube-api-access-8v8xt\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732418 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732295    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d36484f2-3cae-4853-b5cf-c33e630416f2-ca-trust-extracted\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732418 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732326    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-bound-sa-token\") pod \"d36484f2-3cae-4853-b5cf-c33e630416f2\" (UID: \"d36484f2-3cae-4853-b5cf-c33e630416f2\") "
Jul 27 20:52:50.732418 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732378    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:52:50.732596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.732576    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-trusted-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:50.733336 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.733014    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:52:50.747085 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.747035    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36484f2-3cae-4853-b5cf-c33e630416f2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:52:50.748082 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.748042    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:52:50.750784 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.750678    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:52:50.751235 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.751198    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-kube-api-access-8v8xt" (OuterVolumeSpecName: "kube-api-access-8v8xt") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "kube-api-access-8v8xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:52:50.755124 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.754758    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:52:50.759212 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.758785    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r" event={"ID":"d36484f2-3cae-4853-b5cf-c33e630416f2","Type":"ContainerDied","Data":"17922763b9e2fd37b7a2f624041de47ce01c8f4ef8ab2769083c1b4671541694"}
Jul 27 20:52:50.759212 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.758854    2566 scope.go:117] "RemoveContainer" containerID="1dee74b2fd3f6cb620dba832cd3b3c99d7f7584c9660ddfce026f130f52e5987"
Jul 27 20:52:50.759212 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.758875    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557dccd86-cdj7r"
Jul 27 20:52:50.760352 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.760292    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d36484f2-3cae-4853-b5cf-c33e630416f2" (UID: "d36484f2-3cae-4853-b5cf-c33e630416f2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:52:50.764221 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.761864    2566 generic.go:356] "Generic (PLEG): container finished" podID="dde0b560-93eb-4219-b1f5-50687e33ee16" containerID="1f5d319aff12ad34c368738e5899f95b0e5a5bf2338154aef05a31895d2cf9c1" exitCode=0
Jul 27 20:52:50.764221 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.763126    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k42r7" event={"ID":"dde0b560-93eb-4219-b1f5-50687e33ee16","Type":"ContainerDied","Data":"1f5d319aff12ad34c368738e5899f95b0e5a5bf2338154aef05a31895d2cf9c1"}
Jul 27 20:52:50.833782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.833579    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-image-registry-private-configuration\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:50.833782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.833613    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d36484f2-3cae-4853-b5cf-c33e630416f2-installation-pull-secrets\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:50.833782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.833631    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-certificates\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:50.833782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.833646    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-registry-tls\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:50.833782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.833660    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v8xt\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-kube-api-access-8v8xt\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:50.833782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.833674    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d36484f2-3cae-4853-b5cf-c33e630416f2-ca-trust-extracted\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:50.833782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:50.833687    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d36484f2-3cae-4853-b5cf-c33e630416f2-bound-sa-token\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:52:51.099441 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:51.099410    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8557dccd86-cdj7r"]
Jul 27 20:52:51.106708 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:51.106669    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8557dccd86-cdj7r"]
Jul 27 20:52:51.631947 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:51.631917    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78f8898599-mhm9t"
Jul 27 20:52:52.244132 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.244094    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36484f2-3cae-4853-b5cf-c33e630416f2" path="/var/lib/kubelet/pods/d36484f2-3cae-4853-b5cf-c33e630416f2/volumes"
Jul 27 20:52:52.376673 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.376637    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5d4fd495-4px2f"]
Jul 27 20:52:52.413885 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.413851    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c5745b68-bhx4t"]
Jul 27 20:52:52.414299 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.414279    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36484f2-3cae-4853-b5cf-c33e630416f2" containerName="registry"
Jul 27 20:52:52.414299 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.414300    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36484f2-3cae-4853-b5cf-c33e630416f2" containerName="registry"
Jul 27 20:52:52.414561 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.414391    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d36484f2-3cae-4853-b5cf-c33e630416f2" containerName="registry"
Jul 27 20:52:52.490854 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.490813    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5745b68-bhx4t"]
Jul 27 20:52:52.491043 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.490957    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.546981 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.546943    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-serving-cert\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.547182 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.546993    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-oauth-serving-cert\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.547182 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.547027    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-trusted-ca-bundle\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.547182 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.547049    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxr6\" (UniqueName: \"kubernetes.io/projected/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-kube-api-access-5zxr6\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.547182 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.547079    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-service-ca\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.547182 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.547108    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-oauth-config\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.547182 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.547164    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-config\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.647930 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.647883    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-oauth-serving-cert\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648115 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.647947    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-trusted-ca-bundle\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648115 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.648070    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxr6\" (UniqueName: \"kubernetes.io/projected/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-kube-api-access-5zxr6\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648245 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.648124    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-service-ca\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648245 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.648190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-oauth-config\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648352 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.648284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-config\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648399 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.648350    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-serving-cert\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648754 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.648727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-oauth-serving-cert\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.648943 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.648918    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-service-ca\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.649048 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.649027    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-trusted-ca-bundle\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.649770 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.649737    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-config\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.651425 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.651397    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-oauth-config\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.651669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.651647    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-serving-cert\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.657287 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.657264    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxr6\" (UniqueName: \"kubernetes.io/projected/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-kube-api-access-5zxr6\") pod \"console-5c5745b68-bhx4t\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") " pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:52.804162 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:52.804072    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:52:54.791698 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.790418    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk" event={"ID":"9b63e3e1-4c64-4d02-94b9-40c4835f3c74","Type":"ContainerStarted","Data":"59d95d3eec56a159c61fa0a7a4fcb8ae4792476875649856bf199645d5a2e617"}
Jul 27 20:52:54.794275 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.793650    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz" event={"ID":"cc861518-73a7-40c0-9e3f-f33bab1929ba","Type":"ContainerStarted","Data":"900b9becbc39bc1cfe1b55875557f8467100af119e5e1f8268bff2a4ea23c8fe"}
Jul 27 20:52:54.796929 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.796388    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d4fd495-4px2f" event={"ID":"b5fd59af-43f1-40aa-b33c-cf072a5f1712","Type":"ContainerStarted","Data":"333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7"}
Jul 27 20:52:54.808796 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.808458    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh" event={"ID":"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08","Type":"ContainerStarted","Data":"0d3e2d954589cd6a941e194c316debd0b65d59c6656ea123c148d9d4e25aef8d"}
Jul 27 20:52:54.810574 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.810366    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4" event={"ID":"ef3f02bd-7b18-48e3-bcee-466a8ec91038","Type":"ContainerStarted","Data":"98d26490337fc649bc8b0a14c115d826ef83baf8abbae4eda3cba262b6a5a8bf"}
Jul 27 20:52:54.813129 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.812960    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:54.821689 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.820876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k42r7" event={"ID":"dde0b560-93eb-4219-b1f5-50687e33ee16","Type":"ContainerStarted","Data":"e7efea9199e2423485e786fa4466661f4fa571a98f38fc1c702d53e63020cc3f"}
Jul 27 20:52:54.821689 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.820954    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k42r7" event={"ID":"dde0b560-93eb-4219-b1f5-50687e33ee16","Type":"ContainerStarted","Data":"7c066d277428c4ebb5a76b1708a23f23b0c8643c31e46b45cf8af43c11fa3b78"}
Jul 27 20:52:54.822084 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.822033    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4"
Jul 27 20:52:54.865265 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.863708    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f8hbk" podStartSLOduration=6.587116012 podStartE2EDuration="12.863682095s" totalImagesPullingTime="6.276566083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.83234238 +0000 UTC m=+101.128673699" watchObservedRunningTime="2026-07-27 20:52:54.863682095 +0000 UTC m=+101.160013416"
Jul 27 20:52:54.865265 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.865195    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5745b68-bhx4t"]
Jul 27 20:52:54.913735 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.913626    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k42r7" podStartSLOduration=11.170391529 podStartE2EDuration="12.913599926s" totalImagesPullingTime="1.61168895s" totalInitContainerRuntime="131.519447ms" isStatefulPod=true podCreationTimestamp="2026-07-27 20:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.910870978 +0000 UTC m=+101.207202301" watchObservedRunningTime="2026-07-27 20:52:54.913599926 +0000 UTC m=+101.209931245"
Jul 27 20:52:54.913917 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.913829    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz" podStartSLOduration=2.406591743 podStartE2EDuration="8.913819681s" totalImagesPullingTime="6.507227938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.869700661 +0000 UTC m=+101.166031973" watchObservedRunningTime="2026-07-27 20:52:54.913819681 +0000 UTC m=+101.210151000"
Jul 27 20:52:54.956086 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.956026    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d5d4fd495-4px2f" podStartSLOduration=2.5117737079999998 podStartE2EDuration="8.956002499s" totalImagesPullingTime="6.444228791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.955527398 +0000 UTC m=+101.251858714" watchObservedRunningTime="2026-07-27 20:52:54.956002499 +0000 UTC m=+101.252333818"
Jul 27 20:52:54.958522 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:54.958455    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mp8t4" podStartSLOduration=2.627023063 podStartE2EDuration="8.958430062s" totalImagesPullingTime="6.331406999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:54.932685604 +0000 UTC m=+101.229016923" watchObservedRunningTime="2026-07-27 20:52:54.958430062 +0000 UTC m=+101.254761430"
Jul 27 20:52:55.828419 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:55.828377    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5745b68-bhx4t" event={"ID":"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389","Type":"ContainerStarted","Data":"dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1"}
Jul 27 20:52:55.828997 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:55.828484    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5745b68-bhx4t" event={"ID":"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389","Type":"ContainerStarted","Data":"83b0a176173f5f26f1e0e6e9450b6e7e99f36e96a7de5948524625e8e2726d36"}
Jul 27 20:52:55.831278 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:55.831246    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh" event={"ID":"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08","Type":"ContainerStarted","Data":"5551a0e80a98620922798695418d5948c85ee658802b75ee070f719b49fa9522"}
Jul 27 20:52:55.831410 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:55.831304    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh" event={"ID":"9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08","Type":"ContainerStarted","Data":"a03b440c45b4acf25f434ce253c00acd02bcaa169513f7b1f0426cf5e72e54dc"}
Jul 27 20:52:55.848215 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:55.848162    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c5745b68-bhx4t" podStartSLOduration=3.84814672 podStartE2EDuration="3.84814672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:55.84759452 +0000 UTC m=+102.143925847" watchObservedRunningTime="2026-07-27 20:52:55.84814672 +0000 UTC m=+102.144478039"
Jul 27 20:52:55.869650 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:55.869596    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-f8zzh" podStartSLOduration=7.362256227 podStartE2EDuration="13.86957406s" totalImagesPullingTime="6.507317833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:52:55.866184094 +0000 UTC m=+102.162515426" watchObservedRunningTime="2026-07-27 20:52:55.86957406 +0000 UTC m=+102.165905380"
Jul 27 20:52:57.265321 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:52:57.265285    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:53:00.625669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:00.625640    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mlmbw"
Jul 27 20:53:02.805157 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:02.805121    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:53:02.805641 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:02.805185    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:53:02.810047 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:02.810020    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:53:02.869279 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:02.869251    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:53:04.876216 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:04.876181    2566 generic.go:356] "Generic (PLEG): container finished" podID="d445e555-f3e6-446b-b8cc-0f2f75019637" containerID="14ca7ef76ada2df315814d0a705bc95275e1916696771012fb26d851ef9836ae" exitCode=0
Jul 27 20:53:04.876629 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:04.876238    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7rqb6" event={"ID":"d445e555-f3e6-446b-b8cc-0f2f75019637","Type":"ContainerDied","Data":"14ca7ef76ada2df315814d0a705bc95275e1916696771012fb26d851ef9836ae"}
Jul 27 20:53:04.876679 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:04.876635    2566 scope.go:117] "RemoveContainer" containerID="14ca7ef76ada2df315814d0a705bc95275e1916696771012fb26d851ef9836ae"
Jul 27 20:53:05.627008 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:05.626979    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dfcf8dbf5-2qk2g_9ef9bc58-faac-4b38-a236-44cf12a4708f/router/0.log"
Jul 27 20:53:05.634961 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:05.634929    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5csbs_626400fd-a7c4-443c-9ced-94c2b1302ed3/serve-healthcheck-canary/0.log"
Jul 27 20:53:05.883482 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:05.883393    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-7rqb6" event={"ID":"d445e555-f3e6-446b-b8cc-0f2f75019637","Type":"ContainerStarted","Data":"a899a37f810fbf5938d7180affd2c76737f4834a9552c6a08223ed8ebf6f0cc1"}
Jul 27 20:53:06.979857 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:06.979824    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:53:06.980228 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:06.979886    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:53:19.830798 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:19.830723    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d5d4fd495-4px2f" podUID="b5fd59af-43f1-40aa-b33c-cf072a5f1712" containerName="console" containerID="cri-o://333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7" gracePeriod=15
Jul 27 20:53:19.942256 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:19.942163    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e6ad5f3-23f4-44fd-a874-1b9313fad533" containerID="42b45707dbccb799eaa220f15953cae2227da13ff936da02ebc49326d0756fec" exitCode=0
Jul 27 20:53:19.942256 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:19.942227    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x" event={"ID":"2e6ad5f3-23f4-44fd-a874-1b9313fad533","Type":"ContainerDied","Data":"42b45707dbccb799eaa220f15953cae2227da13ff936da02ebc49326d0756fec"}
Jul 27 20:53:19.942607 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:19.942591    2566 scope.go:117] "RemoveContainer" containerID="42b45707dbccb799eaa220f15953cae2227da13ff936da02ebc49326d0756fec"
Jul 27 20:53:20.135277 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.135239    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:53:20.228304 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228205    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-oauth-serving-cert\") pod \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") "
Jul 27 20:53:20.228304 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228262    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt8cl\" (UniqueName: \"kubernetes.io/projected/b5fd59af-43f1-40aa-b33c-cf072a5f1712-kube-api-access-dt8cl\") pod \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") "
Jul 27 20:53:20.228304 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228284    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-trusted-ca-bundle\") pod \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") "
Jul 27 20:53:20.228304 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228301    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-config\") pod \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") "
Jul 27 20:53:20.228669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228317    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-serving-cert\") pod \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") "
Jul 27 20:53:20.228669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228352    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-oauth-config\") pod \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") "
Jul 27 20:53:20.228669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228375    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-service-ca\") pod \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\" (UID: \"b5fd59af-43f1-40aa-b33c-cf072a5f1712\") "
Jul 27 20:53:20.228817 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228795    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-config" (OuterVolumeSpecName: "console-config") pod "b5fd59af-43f1-40aa-b33c-cf072a5f1712" (UID: "b5fd59af-43f1-40aa-b33c-cf072a5f1712"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:20.228870 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228827    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b5fd59af-43f1-40aa-b33c-cf072a5f1712" (UID: "b5fd59af-43f1-40aa-b33c-cf072a5f1712"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:20.228870 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228839    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5fd59af-43f1-40aa-b33c-cf072a5f1712" (UID: "b5fd59af-43f1-40aa-b33c-cf072a5f1712"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:20.228945 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.228896    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5fd59af-43f1-40aa-b33c-cf072a5f1712" (UID: "b5fd59af-43f1-40aa-b33c-cf072a5f1712"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:53:20.230960 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.230933    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5fd59af-43f1-40aa-b33c-cf072a5f1712-kube-api-access-dt8cl" (OuterVolumeSpecName: "kube-api-access-dt8cl") pod "b5fd59af-43f1-40aa-b33c-cf072a5f1712" (UID: "b5fd59af-43f1-40aa-b33c-cf072a5f1712"). InnerVolumeSpecName "kube-api-access-dt8cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:53:20.230960 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.230952    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5fd59af-43f1-40aa-b33c-cf072a5f1712" (UID: "b5fd59af-43f1-40aa-b33c-cf072a5f1712"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:53:20.231127 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.231086    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5fd59af-43f1-40aa-b33c-cf072a5f1712" (UID: "b5fd59af-43f1-40aa-b33c-cf072a5f1712"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:53:20.329574 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.329513    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-oauth-serving-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:53:20.329574 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.329572    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt8cl\" (UniqueName: \"kubernetes.io/projected/b5fd59af-43f1-40aa-b33c-cf072a5f1712-kube-api-access-dt8cl\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:53:20.329775 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.329588    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-trusted-ca-bundle\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:53:20.329775 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.329617    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-config\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:53:20.329775 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.329628    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-serving-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:53:20.329775 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.329636    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5fd59af-43f1-40aa-b33c-cf072a5f1712-console-oauth-config\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:53:20.329775 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.329646    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5fd59af-43f1-40aa-b33c-cf072a5f1712-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:53:20.947965 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.947841    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x" event={"ID":"2e6ad5f3-23f4-44fd-a874-1b9313fad533","Type":"ContainerStarted","Data":"f8571929a2ebfd222f330a3fbcb1c80b0cb15e8e4f63219a80f99033c24821b2"}
Jul 27 20:53:20.949306 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.949278    2566 generic.go:356] "Generic (PLEG): container finished" podID="b5fd59af-43f1-40aa-b33c-cf072a5f1712" containerID="333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7" exitCode=0
Jul 27 20:53:20.949444 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.949327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d4fd495-4px2f" event={"ID":"b5fd59af-43f1-40aa-b33c-cf072a5f1712","Type":"ContainerDied","Data":"333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7"}
Jul 27 20:53:20.949444 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.949368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d4fd495-4px2f" event={"ID":"b5fd59af-43f1-40aa-b33c-cf072a5f1712","Type":"ContainerDied","Data":"f1d5f84351c30c063d89b6bc6cc819fc48e717627db43dc08d2eb962e5febd8e"}
Jul 27 20:53:20.949444 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.949334    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d4fd495-4px2f"
Jul 27 20:53:20.949591 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.949398    2566 scope.go:117] "RemoveContainer" containerID="333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7"
Jul 27 20:53:20.959164 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.959143    2566 scope.go:117] "RemoveContainer" containerID="333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7"
Jul 27 20:53:20.959487 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:53:20.959466    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7\": container with ID starting with 333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7 not found: ID does not exist" containerID="333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7"
Jul 27 20:53:20.959614 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.959500    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7"} err="failed to get container status \"333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7\": rpc error: code = NotFound desc = could not find container \"333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7\": container with ID starting with 333dd8a15d524a8f0da6220e073bc2cd738a4c6372a91a467e787939daddc7b7 not found: ID does not exist"
Jul 27 20:53:20.983998 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.983964    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5d4fd495-4px2f"]
Jul 27 20:53:20.994845 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:20.994811    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d5d4fd495-4px2f"]
Jul 27 20:53:22.241878 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:22.241844    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5fd59af-43f1-40aa-b33c-cf072a5f1712" path="/var/lib/kubelet/pods/b5fd59af-43f1-40aa-b33c-cf072a5f1712/volumes"
Jul 27 20:53:26.985553 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:26.985501    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:53:26.989624 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:53:26.989596    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6485545b46-8d7dz"
Jul 27 20:54:06.435913 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.435876    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568bf86c9b-zjcz4"]
Jul 27 20:54:06.436397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.436206    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5fd59af-43f1-40aa-b33c-cf072a5f1712" containerName="console"
Jul 27 20:54:06.436397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.436219    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5fd59af-43f1-40aa-b33c-cf072a5f1712" containerName="console"
Jul 27 20:54:06.436397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.436267    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5fd59af-43f1-40aa-b33c-cf072a5f1712" containerName="console"
Jul 27 20:54:06.438232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.438209    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.453963 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.453936    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568bf86c9b-zjcz4"]
Jul 27 20:54:06.535004 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.534962    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-trusted-ca-bundle\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.535004 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.535006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-serving-cert\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.535225 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.535032    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-config\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.535225 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.535080    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgpvs\" (UniqueName: \"kubernetes.io/projected/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-kube-api-access-hgpvs\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.535225 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.535145    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-oauth-serving-cert\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.535225 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.535176    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-service-ca\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.535367 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.535229    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-oauth-config\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.636257 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.636218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-oauth-config\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.636453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.636268    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-trusted-ca-bundle\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.636453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.636303    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-serving-cert\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.636453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.636322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-config\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.636453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.636341    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgpvs\" (UniqueName: \"kubernetes.io/projected/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-kube-api-access-hgpvs\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.636743 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.636563    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-oauth-serving-cert\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.636743 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.636625    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-service-ca\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.637151 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.637124    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-config\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.637329 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.637303    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-oauth-serving-cert\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.637380 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.637356    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-trusted-ca-bundle\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.637513 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.637483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-service-ca\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.638952 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.638922    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-serving-cert\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.639048 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.639023    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-oauth-config\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.645523 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.645495    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgpvs\" (UniqueName: \"kubernetes.io/projected/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-kube-api-access-hgpvs\") pod \"console-568bf86c9b-zjcz4\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") " pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.749612 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.749574    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:06.899870 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:06.899837    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568bf86c9b-zjcz4"]
Jul 27 20:54:06.903291 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:54:06.903262    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe05d26d_8eca_421a_ac5d_1ab0f65f2423.slice/crio-eb2b0d4dfecdf867384f691f200f4e70ea48af118ad258ab361d0e50f62c7fdb WatchSource:0}: Error finding container eb2b0d4dfecdf867384f691f200f4e70ea48af118ad258ab361d0e50f62c7fdb: Status 404 returned error can't find the container with id eb2b0d4dfecdf867384f691f200f4e70ea48af118ad258ab361d0e50f62c7fdb
Jul 27 20:54:07.130387 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:07.130288    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bf86c9b-zjcz4" event={"ID":"fe05d26d-8eca-421a-ac5d-1ab0f65f2423","Type":"ContainerStarted","Data":"a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385"}
Jul 27 20:54:07.130387 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:07.130377    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bf86c9b-zjcz4" event={"ID":"fe05d26d-8eca-421a-ac5d-1ab0f65f2423","Type":"ContainerStarted","Data":"eb2b0d4dfecdf867384f691f200f4e70ea48af118ad258ab361d0e50f62c7fdb"}
Jul 27 20:54:07.157643 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:07.157590    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568bf86c9b-zjcz4" podStartSLOduration=1.157574236 podStartE2EDuration="1.157574236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:54:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:54:07.156921518 +0000 UTC m=+173.453252835" watchObservedRunningTime="2026-07-27 20:54:07.157574236 +0000 UTC m=+173.453905555"
Jul 27 20:54:16.750641 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:16.750600    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:16.751092 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:16.750706    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:16.755882 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:16.755857    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:17.175080 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:17.174998    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:54:17.222562 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:17.222514    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5745b68-bhx4t"]
Jul 27 20:54:42.247139 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.247100    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c5745b68-bhx4t" podUID="3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" containerName="console" containerID="cri-o://dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1" gracePeriod=15
Jul 27 20:54:42.493173 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.493145    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:54:42.502207 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502144    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-trusted-ca-bundle\") pod \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") "
Jul 27 20:54:42.502339 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502261    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-config\") pod \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") "
Jul 27 20:54:42.502339 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502291    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-oauth-config\") pod \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") "
Jul 27 20:54:42.502339 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502327    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-serving-cert\") pod \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") "
Jul 27 20:54:42.502490 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502359    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-oauth-serving-cert\") pod \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") "
Jul 27 20:54:42.502490 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502383    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zxr6\" (UniqueName: \"kubernetes.io/projected/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-kube-api-access-5zxr6\") pod \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") "
Jul 27 20:54:42.502490 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502453    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-service-ca\") pod \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\" (UID: \"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389\") "
Jul 27 20:54:42.502774 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502735    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-config" (OuterVolumeSpecName: "console-config") pod "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" (UID: "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:54:42.502853 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502826    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" (UID: "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:54:42.503004 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.502978    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" (UID: "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:54:42.503113 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.503028    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" (UID: "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:54:42.504677 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.504649    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" (UID: "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:42.504772 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.504753    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" (UID: "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:54:42.504936 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.504908    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-kube-api-access-5zxr6" (OuterVolumeSpecName: "kube-api-access-5zxr6") pod "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" (UID: "3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389"). InnerVolumeSpecName "kube-api-access-5zxr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:54:42.603525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.603483    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-trusted-ca-bundle\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:54:42.603525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.603520    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-config\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:54:42.603525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.603552    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-oauth-config\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:54:42.603525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.603566    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-console-serving-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:54:42.603836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.603579    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-oauth-serving-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:54:42.603836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.603591    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zxr6\" (UniqueName: \"kubernetes.io/projected/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-kube-api-access-5zxr6\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:54:42.603836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:42.603603    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:54:43.276272 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.276235    2566 generic.go:356] "Generic (PLEG): container finished" podID="3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" containerID="dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1" exitCode=0
Jul 27 20:54:43.276700 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.276302    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5745b68-bhx4t"
Jul 27 20:54:43.276700 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.276319    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5745b68-bhx4t" event={"ID":"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389","Type":"ContainerDied","Data":"dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1"}
Jul 27 20:54:43.276700 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.276394    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5745b68-bhx4t" event={"ID":"3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389","Type":"ContainerDied","Data":"83b0a176173f5f26f1e0e6e9450b6e7e99f36e96a7de5948524625e8e2726d36"}
Jul 27 20:54:43.276700 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.276415    2566 scope.go:117] "RemoveContainer" containerID="dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1"
Jul 27 20:54:43.285406 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.285388    2566 scope.go:117] "RemoveContainer" containerID="dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1"
Jul 27 20:54:43.285765 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:54:43.285739    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1\": container with ID starting with dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1 not found: ID does not exist" containerID="dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1"
Jul 27 20:54:43.285851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.285779    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1"} err="failed to get container status \"dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1\": rpc error: code = NotFound desc = could not find container \"dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1\": container with ID starting with dd24211f47f9fa48150b65f1369cf0c63d47e829c96197d5425f2adfb047b9f1 not found: ID does not exist"
Jul 27 20:54:43.298927 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.298889    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5745b68-bhx4t"]
Jul 27 20:54:43.308028 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:43.307998    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c5745b68-bhx4t"]
Jul 27 20:54:44.241856 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:54:44.241821    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" path="/var/lib/kubelet/pods/3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389/volumes"
Jul 27 20:55:05.048524 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.048485    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"]
Jul 27 20:55:05.049043 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.048817    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" containerName="console"
Jul 27 20:55:05.049043 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.048829    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" containerName="console"
Jul 27 20:55:05.049043 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.048896    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca2c4d2-83ce-4fd5-9c83-41ed37bd3389" containerName="console"
Jul 27 20:55:05.050870 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.050853    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.054156 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.054128    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zlhqk\""
Jul 27 20:55:05.054156 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.054131    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:55:05.054484 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.054468    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 20:55:05.066957 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.066932    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"]
Jul 27 20:55:05.090834 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.090799    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84961c58-8785-4c27-a56e-c333f212a26e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pg9zl\" (UID: \"84961c58-8785-4c27-a56e-c333f212a26e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.091008 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.090842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26bhl\" (UniqueName: \"kubernetes.io/projected/84961c58-8785-4c27-a56e-c333f212a26e-kube-api-access-26bhl\") pod \"cert-manager-operator-controller-manager-55c444bf86-pg9zl\" (UID: \"84961c58-8785-4c27-a56e-c333f212a26e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.192337 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.192295    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84961c58-8785-4c27-a56e-c333f212a26e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pg9zl\" (UID: \"84961c58-8785-4c27-a56e-c333f212a26e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.192337 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.192336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26bhl\" (UniqueName: \"kubernetes.io/projected/84961c58-8785-4c27-a56e-c333f212a26e-kube-api-access-26bhl\") pod \"cert-manager-operator-controller-manager-55c444bf86-pg9zl\" (UID: \"84961c58-8785-4c27-a56e-c333f212a26e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.192733 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.192711    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84961c58-8785-4c27-a56e-c333f212a26e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pg9zl\" (UID: \"84961c58-8785-4c27-a56e-c333f212a26e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.203093 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.203071    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26bhl\" (UniqueName: \"kubernetes.io/projected/84961c58-8785-4c27-a56e-c333f212a26e-kube-api-access-26bhl\") pod \"cert-manager-operator-controller-manager-55c444bf86-pg9zl\" (UID: \"84961c58-8785-4c27-a56e-c333f212a26e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.360113 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.360013    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"
Jul 27 20:55:05.501723 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:05.501680    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl"]
Jul 27 20:55:05.505131 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:55:05.505105    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84961c58_8785_4c27_a56e_c333f212a26e.slice/crio-307b4b1cf0ce3662ae3eb4635e547f189682a9c19a34633610581255f38b7533 WatchSource:0}: Error finding container 307b4b1cf0ce3662ae3eb4635e547f189682a9c19a34633610581255f38b7533: Status 404 returned error can't find the container with id 307b4b1cf0ce3662ae3eb4635e547f189682a9c19a34633610581255f38b7533
Jul 27 20:55:06.369737 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:06.369696    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl" event={"ID":"84961c58-8785-4c27-a56e-c333f212a26e","Type":"ContainerStarted","Data":"307b4b1cf0ce3662ae3eb4635e547f189682a9c19a34633610581255f38b7533"}
Jul 27 20:55:08.380326 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.380285    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl" event={"ID":"84961c58-8785-4c27-a56e-c333f212a26e","Type":"ContainerStarted","Data":"b6eaa17254e6afb6d57bc160b75e3ffdfff19275f8e19628b5ef1707bdf7c801"}
Jul 27 20:55:08.403789 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.403726    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pg9zl" podStartSLOduration=0.750906076 podStartE2EDuration="3.403705972s" totalImagesPullingTime="2.652799896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:08.402212866 +0000 UTC m=+234.698544198" watchObservedRunningTime="2026-07-27 20:55:08.403705972 +0000 UTC m=+234.700037291"
Jul 27 20:55:08.889718 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.889681    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"]
Jul 27 20:55:08.892063 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.892040    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:08.895191 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.895169    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 20:55:08.895709 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.895667    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ckf8j\""
Jul 27 20:55:08.896421 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.896400    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 20:55:08.910135 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:08.910108    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"]
Jul 27 20:55:09.025374 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.025329    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cczdn\" (UniqueName: \"kubernetes.io/projected/acb550ec-4f0d-43b4-a6db-0324a074b10d-kube-api-access-cczdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.025581 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.025385    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.025581 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.025476    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.126111 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.126071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.126268 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.126123    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cczdn\" (UniqueName: \"kubernetes.io/projected/acb550ec-4f0d-43b4-a6db-0324a074b10d-kube-api-access-cczdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.126268 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.126156    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.126526 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.126504    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.126526 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.126517    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.140350 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.140282    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cczdn\" (UniqueName: \"kubernetes.io/projected/acb550ec-4f0d-43b4-a6db-0324a074b10d-kube-api-access-cczdn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.201818 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.201785    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:09.342901 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.342846    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"]
Jul 27 20:55:09.346099 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:55:09.346072    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb550ec_4f0d_43b4_a6db_0324a074b10d.slice/crio-ff80b69f7c765562c3b3825eeaae07cc5451a01135d4ab7d22a224e865f577d4 WatchSource:0}: Error finding container ff80b69f7c765562c3b3825eeaae07cc5451a01135d4ab7d22a224e865f577d4: Status 404 returned error can't find the container with id ff80b69f7c765562c3b3825eeaae07cc5451a01135d4ab7d22a224e865f577d4
Jul 27 20:55:09.385814 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:09.385780    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj" event={"ID":"acb550ec-4f0d-43b4-a6db-0324a074b10d","Type":"ContainerStarted","Data":"ff80b69f7c765562c3b3825eeaae07cc5451a01135d4ab7d22a224e865f577d4"}
Jul 27 20:55:12.491635 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.491591    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"]
Jul 27 20:55:12.493994 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.493967    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.496831 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.496769    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 20:55:12.496967 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.496868    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q8lwp\""
Jul 27 20:55:12.498003 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.497979    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 20:55:12.510060 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.510030    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"]
Jul 27 20:55:12.559428 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.559393    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d69wd\" (UniqueName: \"kubernetes.io/projected/a5fc40ea-5697-476e-b211-3d2c8b66e5ac-kube-api-access-d69wd\") pod \"cert-manager-cainjector-559cdd8c87-s74v8\" (UID: \"a5fc40ea-5697-476e-b211-3d2c8b66e5ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.559624 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.559481    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fc40ea-5697-476e-b211-3d2c8b66e5ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s74v8\" (UID: \"a5fc40ea-5697-476e-b211-3d2c8b66e5ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.660893 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.660852    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fc40ea-5697-476e-b211-3d2c8b66e5ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s74v8\" (UID: \"a5fc40ea-5697-476e-b211-3d2c8b66e5ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.661069 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.660996    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d69wd\" (UniqueName: \"kubernetes.io/projected/a5fc40ea-5697-476e-b211-3d2c8b66e5ac-kube-api-access-d69wd\") pod \"cert-manager-cainjector-559cdd8c87-s74v8\" (UID: \"a5fc40ea-5697-476e-b211-3d2c8b66e5ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.675438 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.675405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5fc40ea-5697-476e-b211-3d2c8b66e5ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s74v8\" (UID: \"a5fc40ea-5697-476e-b211-3d2c8b66e5ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.675691 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.675663    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d69wd\" (UniqueName: \"kubernetes.io/projected/a5fc40ea-5697-476e-b211-3d2c8b66e5ac-kube-api-access-d69wd\") pod \"cert-manager-cainjector-559cdd8c87-s74v8\" (UID: \"a5fc40ea-5697-476e-b211-3d2c8b66e5ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.814279 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.814189    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"
Jul 27 20:55:12.966611 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:12.966578    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s74v8"]
Jul 27 20:55:12.971006 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:55:12.970970    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5fc40ea_5697_476e_b211_3d2c8b66e5ac.slice/crio-f3bfe65be8e91d681b9477de046f0c0d263e5aaad8defb33fd0ef71cb898ce62 WatchSource:0}: Error finding container f3bfe65be8e91d681b9477de046f0c0d263e5aaad8defb33fd0ef71cb898ce62: Status 404 returned error can't find the container with id f3bfe65be8e91d681b9477de046f0c0d263e5aaad8defb33fd0ef71cb898ce62
Jul 27 20:55:13.406189 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:13.406147    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8" event={"ID":"a5fc40ea-5697-476e-b211-3d2c8b66e5ac","Type":"ContainerStarted","Data":"f3bfe65be8e91d681b9477de046f0c0d263e5aaad8defb33fd0ef71cb898ce62"}
Jul 27 20:55:16.422846 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:16.422803    2566 generic.go:356] "Generic (PLEG): container finished" podID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerID="d5b3791ee0ef9d104c767fd1fdeb174f689dcba938c0a04a2121960bd2fc1e95" exitCode=0
Jul 27 20:55:16.423286 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:16.422889    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj" event={"ID":"acb550ec-4f0d-43b4-a6db-0324a074b10d","Type":"ContainerDied","Data":"d5b3791ee0ef9d104c767fd1fdeb174f689dcba938c0a04a2121960bd2fc1e95"}
Jul 27 20:55:17.211673 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.211634    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tz4dn"]
Jul 27 20:55:17.214227 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.214205    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.217888 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.217820    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-c59j6\""
Jul 27 20:55:17.235677 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.235612    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tz4dn"]
Jul 27 20:55:17.306148 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.306105    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c34c7b08-b42c-475e-b223-452abbca3a7f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tz4dn\" (UID: \"c34c7b08-b42c-475e-b223-452abbca3a7f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.306300 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.306159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjww\" (UniqueName: \"kubernetes.io/projected/c34c7b08-b42c-475e-b223-452abbca3a7f-kube-api-access-4gjww\") pod \"cert-manager-webhook-6486ffd997-tz4dn\" (UID: \"c34c7b08-b42c-475e-b223-452abbca3a7f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.407496 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.407454    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c34c7b08-b42c-475e-b223-452abbca3a7f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tz4dn\" (UID: \"c34c7b08-b42c-475e-b223-452abbca3a7f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.407701 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.407512    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjww\" (UniqueName: \"kubernetes.io/projected/c34c7b08-b42c-475e-b223-452abbca3a7f-kube-api-access-4gjww\") pod \"cert-manager-webhook-6486ffd997-tz4dn\" (UID: \"c34c7b08-b42c-475e-b223-452abbca3a7f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.418320 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.418256    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c34c7b08-b42c-475e-b223-452abbca3a7f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tz4dn\" (UID: \"c34c7b08-b42c-475e-b223-452abbca3a7f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.420050 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.420022    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjww\" (UniqueName: \"kubernetes.io/projected/c34c7b08-b42c-475e-b223-452abbca3a7f-kube-api-access-4gjww\") pod \"cert-manager-webhook-6486ffd997-tz4dn\" (UID: \"c34c7b08-b42c-475e-b223-452abbca3a7f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.431109 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.431001    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8" event={"ID":"a5fc40ea-5697-476e-b211-3d2c8b66e5ac","Type":"ContainerStarted","Data":"29d131328a3b6abd150848920ab58df0c8970ac52705d1b5a75d05a56536c367"}
Jul 27 20:55:17.468858 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.468720    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s74v8" podStartSLOduration=1.109500002 podStartE2EDuration="5.468699701s" totalImagesPullingTime="4.359199699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:17.467516375 +0000 UTC m=+243.763847817" watchObservedRunningTime="2026-07-27 20:55:17.468699701 +0000 UTC m=+243.765031020"
Jul 27 20:55:17.526801 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.526764    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:17.706233 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:17.706198    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tz4dn"]
Jul 27 20:55:17.712194 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:55:17.712158    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc34c7b08_b42c_475e_b223_452abbca3a7f.slice/crio-9dd264998ecf851b46abe341f1567ff2d926ffef5fe6b4949d2e66ea51a825ba WatchSource:0}: Error finding container 9dd264998ecf851b46abe341f1567ff2d926ffef5fe6b4949d2e66ea51a825ba: Status 404 returned error can't find the container with id 9dd264998ecf851b46abe341f1567ff2d926ffef5fe6b4949d2e66ea51a825ba
Jul 27 20:55:18.439354 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:18.439313    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn" event={"ID":"c34c7b08-b42c-475e-b223-452abbca3a7f","Type":"ContainerStarted","Data":"cc107244f629fa6d9364004a87611653485256b4ed3e973b6765af7ef4a5c091"}
Jul 27 20:55:18.439819 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:18.439369    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn" event={"ID":"c34c7b08-b42c-475e-b223-452abbca3a7f","Type":"ContainerStarted","Data":"9dd264998ecf851b46abe341f1567ff2d926ffef5fe6b4949d2e66ea51a825ba"}
Jul 27 20:55:18.439819 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:18.439457    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:18.464480 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:18.464418    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn" podStartSLOduration=1.464397253 podStartE2EDuration="1.464397253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:55:18.464366254 +0000 UTC m=+244.760697573" watchObservedRunningTime="2026-07-27 20:55:18.464397253 +0000 UTC m=+244.760728574"
Jul 27 20:55:19.445456 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:19.445420    2566 generic.go:356] "Generic (PLEG): container finished" podID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerID="d34038c91a3ead10ab35e06353e8f16b6a2e514882607a0668f549f90433c4f9" exitCode=0
Jul 27 20:55:19.445980 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:19.445507    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj" event={"ID":"acb550ec-4f0d-43b4-a6db-0324a074b10d","Type":"ContainerDied","Data":"d34038c91a3ead10ab35e06353e8f16b6a2e514882607a0668f549f90433c4f9"}
Jul 27 20:55:24.448820 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:24.448777    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tz4dn"
Jul 27 20:55:26.481110 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:26.481006    2566 generic.go:356] "Generic (PLEG): container finished" podID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerID="eaf38a3141f3377875ec3484f10fe4a0d2dbb781720ac546784f58919178788f" exitCode=0
Jul 27 20:55:26.481110 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:26.481092    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj" event={"ID":"acb550ec-4f0d-43b4-a6db-0324a074b10d","Type":"ContainerDied","Data":"eaf38a3141f3377875ec3484f10fe4a0d2dbb781720ac546784f58919178788f"}
Jul 27 20:55:27.613638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.613614    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:27.705638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.705597    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cczdn\" (UniqueName: \"kubernetes.io/projected/acb550ec-4f0d-43b4-a6db-0324a074b10d-kube-api-access-cczdn\") pod \"acb550ec-4f0d-43b4-a6db-0324a074b10d\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") "
Jul 27 20:55:27.705638 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.705637    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-bundle\") pod \"acb550ec-4f0d-43b4-a6db-0324a074b10d\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") "
Jul 27 20:55:27.705851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.705719    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-util\") pod \"acb550ec-4f0d-43b4-a6db-0324a074b10d\" (UID: \"acb550ec-4f0d-43b4-a6db-0324a074b10d\") "
Jul 27 20:55:27.706126 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.706099    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-bundle" (OuterVolumeSpecName: "bundle") pod "acb550ec-4f0d-43b4-a6db-0324a074b10d" (UID: "acb550ec-4f0d-43b4-a6db-0324a074b10d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:55:27.708049 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.708025    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb550ec-4f0d-43b4-a6db-0324a074b10d-kube-api-access-cczdn" (OuterVolumeSpecName: "kube-api-access-cczdn") pod "acb550ec-4f0d-43b4-a6db-0324a074b10d" (UID: "acb550ec-4f0d-43b4-a6db-0324a074b10d"). InnerVolumeSpecName "kube-api-access-cczdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:55:27.709802 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.709775    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-util" (OuterVolumeSpecName: "util") pod "acb550ec-4f0d-43b4-a6db-0324a074b10d" (UID: "acb550ec-4f0d-43b4-a6db-0324a074b10d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:55:27.806826 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.806718    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-util\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:55:27.806826 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.806770    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cczdn\" (UniqueName: \"kubernetes.io/projected/acb550ec-4f0d-43b4-a6db-0324a074b10d-kube-api-access-cczdn\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:55:27.806826 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:27.806781    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acb550ec-4f0d-43b4-a6db-0324a074b10d-bundle\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:55:28.491469 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:28.491431    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj" event={"ID":"acb550ec-4f0d-43b4-a6db-0324a074b10d","Type":"ContainerDied","Data":"ff80b69f7c765562c3b3825eeaae07cc5451a01135d4ab7d22a224e865f577d4"}
Jul 27 20:55:28.491647 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:28.491481    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhsslj"
Jul 27 20:55:28.491647 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:28.491487    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff80b69f7c765562c3b3825eeaae07cc5451a01135d4ab7d22a224e865f577d4"
Jul 27 20:55:57.447247 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447198    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"]
Jul 27 20:55:57.447843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447650    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerName="extract"
Jul 27 20:55:57.447843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447668    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerName="extract"
Jul 27 20:55:57.447843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447688    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerName="util"
Jul 27 20:55:57.447843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447697    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerName="util"
Jul 27 20:55:57.447843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447716    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerName="pull"
Jul 27 20:55:57.447843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447725    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerName="pull"
Jul 27 20:55:57.447843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.447817    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="acb550ec-4f0d-43b4-a6db-0324a074b10d" containerName="extract"
Jul 27 20:55:57.467842 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.467805    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.473281 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.473247    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 20:55:57.473435 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.473395    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 20:55:57.474717 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.474697    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 20:55:57.475849 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.475831    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 20:55:57.476127 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.476108    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h72pm\""
Jul 27 20:55:57.477908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.477887    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"]
Jul 27 20:55:57.531053 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.531009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twnsr\" (UniqueName: \"kubernetes.io/projected/9efa8706-dc9a-4c73-9bf1-39653afaf48d-kube-api-access-twnsr\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.531053 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.531054    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9efa8706-dc9a-4c73-9bf1-39653afaf48d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.531311 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.531087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9efa8706-dc9a-4c73-9bf1-39653afaf48d-tmp\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.531311 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.531164    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9efa8706-dc9a-4c73-9bf1-39653afaf48d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.531311 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.531189    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9efa8706-dc9a-4c73-9bf1-39653afaf48d-manifests\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.631645 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.631603    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twnsr\" (UniqueName: \"kubernetes.io/projected/9efa8706-dc9a-4c73-9bf1-39653afaf48d-kube-api-access-twnsr\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.631645 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.631645    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9efa8706-dc9a-4c73-9bf1-39653afaf48d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.631882 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.631824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9efa8706-dc9a-4c73-9bf1-39653afaf48d-tmp\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.631980 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.631961    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9efa8706-dc9a-4c73-9bf1-39653afaf48d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.632040 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.631998    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9efa8706-dc9a-4c73-9bf1-39653afaf48d-manifests\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.632307 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.632282    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9efa8706-dc9a-4c73-9bf1-39653afaf48d-manifests\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.634291 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.634243    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9efa8706-dc9a-4c73-9bf1-39653afaf48d-tmp\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.634412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.634339    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9efa8706-dc9a-4c73-9bf1-39653afaf48d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.634412 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.634349    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9efa8706-dc9a-4c73-9bf1-39653afaf48d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.661642 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.661613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twnsr\" (UniqueName: \"kubernetes.io/projected/9efa8706-dc9a-4c73-9bf1-39653afaf48d-kube-api-access-twnsr\") pod \"opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d\" (UID: \"9efa8706-dc9a-4c73-9bf1-39653afaf48d\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:57.779489 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:57.779444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:55:58.011954 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:58.011925    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"]
Jul 27 20:55:58.014412 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:55:58.014375    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9efa8706_dc9a_4c73_9bf1_39653afaf48d.slice/crio-b85e4c111d3582693167944b44c755850074b7105522cfab95b593ac79932a06 WatchSource:0}: Error finding container b85e4c111d3582693167944b44c755850074b7105522cfab95b593ac79932a06: Status 404 returned error can't find the container with id b85e4c111d3582693167944b44c755850074b7105522cfab95b593ac79932a06
Jul 27 20:55:58.620183 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:55:58.620145    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d" event={"ID":"9efa8706-dc9a-4c73-9bf1-39653afaf48d","Type":"ContainerStarted","Data":"b85e4c111d3582693167944b44c755850074b7105522cfab95b593ac79932a06"}
Jul 27 20:56:01.635373 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:01.635282    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d" event={"ID":"9efa8706-dc9a-4c73-9bf1-39653afaf48d","Type":"ContainerStarted","Data":"be34cfaff557996f9c7acc5b5a714a172aac0e38778f32fc80151a72fcea653d"}
Jul 27 20:56:02.641738 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:02.641703    2566 generic.go:356] "Generic (PLEG): container finished" podID="9efa8706-dc9a-4c73-9bf1-39653afaf48d" containerID="be34cfaff557996f9c7acc5b5a714a172aac0e38778f32fc80151a72fcea653d" exitCode=0
Jul 27 20:56:02.642143 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:02.641794    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d" event={"ID":"9efa8706-dc9a-4c73-9bf1-39653afaf48d","Type":"ContainerDied","Data":"be34cfaff557996f9c7acc5b5a714a172aac0e38778f32fc80151a72fcea653d"}
Jul 27 20:56:03.652838 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:03.652798    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d" event={"ID":"9efa8706-dc9a-4c73-9bf1-39653afaf48d","Type":"ContainerStarted","Data":"43f79a4db49579aa5353b50cd32364419ee4bedd783c0bff07a705623d65c8f3"}
Jul 27 20:56:03.653259 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:03.652903    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:56:03.690169 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:03.690110    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d" podStartSLOduration=1.945189739 podStartE2EDuration="6.6900908s" totalImagesPullingTime="3.65799329s" totalInitContainerRuntime="1.086907771s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:55:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:03.688881718 +0000 UTC m=+289.985213037" watchObservedRunningTime="2026-07-27 20:56:03.6900908 +0000 UTC m=+289.986422112"
Jul 27 20:56:14.098622 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:14.098589    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 20:56:14.105235 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:14.105209    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 20:56:14.110856 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:14.110830    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 20:56:14.661750 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:14.661721    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d"
Jul 27 20:56:18.625277 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.625238    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"]
Jul 27 20:56:18.628070 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.628047    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.633097 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.633068    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 20:56:18.634311 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.634290    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sxx96\""
Jul 27 20:56:18.634311 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.634301    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 20:56:18.673843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.673806    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"]
Jul 27 20:56:18.715473 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.715425    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-tls-certs\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.715688 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.715503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djwkh\" (UniqueName: \"kubernetes.io/projected/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-kube-api-access-djwkh\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.715688 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.715577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-tmp\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.816062 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.816025    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-tmp\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.816262 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.816085    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-tls-certs\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.816262 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.816114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djwkh\" (UniqueName: \"kubernetes.io/projected/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-kube-api-access-djwkh\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.819126 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.819097    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-tmp\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.819311 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.819285    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-tls-certs\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.862043 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.862004    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djwkh\" (UniqueName: \"kubernetes.io/projected/8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01-kube-api-access-djwkh\") pod \"kube-auth-proxy-6f4ccdc5cb-45zfl\" (UID: \"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01\") " pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:18.900963 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.900867    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7wjzv"]
Jul 27 20:56:18.903804 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.903764    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:18.908211 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.908169    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2vjtt\""
Jul 27 20:56:18.910771 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.910749    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 20:56:18.923304 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.923275    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7wjzv"]
Jul 27 20:56:18.940136 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:18.940097    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"
Jul 27 20:56:19.018408 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.018251    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b58ff\" (UniqueName: \"kubernetes.io/projected/11f37e92-f71b-4d9b-99ec-ab96671a5f41-kube-api-access-b58ff\") pod \"odh-model-controller-7998c67dc4-7wjzv\" (UID: \"11f37e92-f71b-4d9b-99ec-ab96671a5f41\") " pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:19.018408 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.018323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f37e92-f71b-4d9b-99ec-ab96671a5f41-cert\") pod \"odh-model-controller-7998c67dc4-7wjzv\" (UID: \"11f37e92-f71b-4d9b-99ec-ab96671a5f41\") " pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:19.120372 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.119952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b58ff\" (UniqueName: \"kubernetes.io/projected/11f37e92-f71b-4d9b-99ec-ab96671a5f41-kube-api-access-b58ff\") pod \"odh-model-controller-7998c67dc4-7wjzv\" (UID: \"11f37e92-f71b-4d9b-99ec-ab96671a5f41\") " pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:19.120372 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.120019    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f37e92-f71b-4d9b-99ec-ab96671a5f41-cert\") pod \"odh-model-controller-7998c67dc4-7wjzv\" (UID: \"11f37e92-f71b-4d9b-99ec-ab96671a5f41\") " pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:19.120372 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:56:19.120161    2566 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 27 20:56:19.120372 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:56:19.120238    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f37e92-f71b-4d9b-99ec-ab96671a5f41-cert podName:11f37e92-f71b-4d9b-99ec-ab96671a5f41 nodeName:}" failed. No retries permitted until 2026-07-27 20:56:19.620204592 +0000 UTC m=+305.916535902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f37e92-f71b-4d9b-99ec-ab96671a5f41-cert") pod "odh-model-controller-7998c67dc4-7wjzv" (UID: "11f37e92-f71b-4d9b-99ec-ab96671a5f41") : secret "odh-model-controller-webhook-cert" not found
Jul 27 20:56:19.132343 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.132258    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl"]
Jul 27 20:56:19.135697 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:56:19.135666    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3746f0_f8e6_4d7b_9caf_9a5c5ec35f01.slice/crio-1807c7a137be84a80d1e24a1c761cd7f95306f38addae2b44f3f2b50585f8346 WatchSource:0}: Error finding container 1807c7a137be84a80d1e24a1c761cd7f95306f38addae2b44f3f2b50585f8346: Status 404 returned error can't find the container with id 1807c7a137be84a80d1e24a1c761cd7f95306f38addae2b44f3f2b50585f8346
Jul 27 20:56:19.137769 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.137750    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:56:19.139239 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.139218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b58ff\" (UniqueName: \"kubernetes.io/projected/11f37e92-f71b-4d9b-99ec-ab96671a5f41-kube-api-access-b58ff\") pod \"odh-model-controller-7998c67dc4-7wjzv\" (UID: \"11f37e92-f71b-4d9b-99ec-ab96671a5f41\") " pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:19.625138 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.625092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f37e92-f71b-4d9b-99ec-ab96671a5f41-cert\") pod \"odh-model-controller-7998c67dc4-7wjzv\" (UID: \"11f37e92-f71b-4d9b-99ec-ab96671a5f41\") " pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:19.627843 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.627805    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f37e92-f71b-4d9b-99ec-ab96671a5f41-cert\") pod \"odh-model-controller-7998c67dc4-7wjzv\" (UID: \"11f37e92-f71b-4d9b-99ec-ab96671a5f41\") " pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:19.733021 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.732974    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl" event={"ID":"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01","Type":"ContainerStarted","Data":"1807c7a137be84a80d1e24a1c761cd7f95306f38addae2b44f3f2b50585f8346"}
Jul 27 20:56:19.818648 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.818601    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:20.000796 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:19.996448    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7wjzv"]
Jul 27 20:56:20.282028 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.281987    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sdcbd"]
Jul 27 20:56:20.284801 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.284779    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.289800 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.289718    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nhfh4\""
Jul 27 20:56:20.289937 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.289850    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 20:56:20.328129 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.328077    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sdcbd"]
Jul 27 20:56:20.438752 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.438713    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3213cdbc-081d-433e-a695-036f51ae5da7-tls-certs\") pod \"model-serving-api-54d89bd5fc-sdcbd\" (UID: \"3213cdbc-081d-433e-a695-036f51ae5da7\") " pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.438919 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.438790    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgs75\" (UniqueName: \"kubernetes.io/projected/3213cdbc-081d-433e-a695-036f51ae5da7-kube-api-access-vgs75\") pod \"model-serving-api-54d89bd5fc-sdcbd\" (UID: \"3213cdbc-081d-433e-a695-036f51ae5da7\") " pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.540361 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.540118    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3213cdbc-081d-433e-a695-036f51ae5da7-tls-certs\") pod \"model-serving-api-54d89bd5fc-sdcbd\" (UID: \"3213cdbc-081d-433e-a695-036f51ae5da7\") " pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.540361 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.540183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgs75\" (UniqueName: \"kubernetes.io/projected/3213cdbc-081d-433e-a695-036f51ae5da7-kube-api-access-vgs75\") pod \"model-serving-api-54d89bd5fc-sdcbd\" (UID: \"3213cdbc-081d-433e-a695-036f51ae5da7\") " pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.543494 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.543437    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3213cdbc-081d-433e-a695-036f51ae5da7-tls-certs\") pod \"model-serving-api-54d89bd5fc-sdcbd\" (UID: \"3213cdbc-081d-433e-a695-036f51ae5da7\") " pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.559250 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.559218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgs75\" (UniqueName: \"kubernetes.io/projected/3213cdbc-081d-433e-a695-036f51ae5da7-kube-api-access-vgs75\") pod \"model-serving-api-54d89bd5fc-sdcbd\" (UID: \"3213cdbc-081d-433e-a695-036f51ae5da7\") " pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.597337 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.597304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:20.762573 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.762466    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv" event={"ID":"11f37e92-f71b-4d9b-99ec-ab96671a5f41","Type":"ContainerStarted","Data":"63aa8d0adfa084904c6f32ae004da940c28c8e82931cb5d27f8d9a70ffb916b9"}
Jul 27 20:56:20.833116 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.832400    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sdcbd"]
Jul 27 20:56:20.837718 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:56:20.837615    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3213cdbc_081d_433e_a695_036f51ae5da7.slice/crio-71b4729bd59cbe753cc09ed25207b6866ac8b868526989a4a6292a99842f5f27 WatchSource:0}: Error finding container 71b4729bd59cbe753cc09ed25207b6866ac8b868526989a4a6292a99842f5f27: Status 404 returned error can't find the container with id 71b4729bd59cbe753cc09ed25207b6866ac8b868526989a4a6292a99842f5f27
Jul 27 20:56:20.966434 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.966195    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"]
Jul 27 20:56:20.969256 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.969231    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:20.974017 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.973990    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 20:56:20.974306 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.974285    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 20:56:20.974694 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.974524    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t5tms\""
Jul 27 20:56:20.974694 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.974632    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 20:56:20.974840 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.974798    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 20:56:20.991448 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:20.991419    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"]
Jul 27 20:56:21.055907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.055516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.055907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.055615    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.055907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.055686    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.055907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.055741    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d67941d-a273-4e64-9053-d63af5e19db0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.055907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.055786    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.055907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.055811    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.055907 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.055829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdz4\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-kube-api-access-wsdz4\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.156810 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.156717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.156810 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.156766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.156810 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.156798    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdz4\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-kube-api-access-wsdz4\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.157075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.156835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.157075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.156885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.157075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.156917    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.157075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.157000    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d67941d-a273-4e64-9053-d63af5e19db0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.158298 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.158230    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.160364 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.160334    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d67941d-a273-4e64-9053-d63af5e19db0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.160493 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.160397    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.161469 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.161433    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.161792 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.161774    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.171098 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.171069    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdz4\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-kube-api-access-wsdz4\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.173596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.173565    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-vjqqb\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.283421 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.283375    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:21.773864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:21.773818    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd" event={"ID":"3213cdbc-081d-433e-a695-036f51ae5da7","Type":"ContainerStarted","Data":"71b4729bd59cbe753cc09ed25207b6866ac8b868526989a4a6292a99842f5f27"}
Jul 27 20:56:24.105951 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.105917    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"]
Jul 27 20:56:24.109255 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:56:24.109211    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d67941d_a273_4e64_9053_d63af5e19db0.slice/crio-5072adf164ab34d97f72108c7f7259f339f148e63e8a64e09287aa80c1143081 WatchSource:0}: Error finding container 5072adf164ab34d97f72108c7f7259f339f148e63e8a64e09287aa80c1143081: Status 404 returned error can't find the container with id 5072adf164ab34d97f72108c7f7259f339f148e63e8a64e09287aa80c1143081
Jul 27 20:56:24.790803 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.790762    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb" event={"ID":"0d67941d-a273-4e64-9053-d63af5e19db0","Type":"ContainerStarted","Data":"5072adf164ab34d97f72108c7f7259f339f148e63e8a64e09287aa80c1143081"}
Jul 27 20:56:24.792244 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.792218    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv" event={"ID":"11f37e92-f71b-4d9b-99ec-ab96671a5f41","Type":"ContainerStarted","Data":"ac6abf63ed67e6d1afcc6275fa1ea82b77ae96c1638c855154f371f88a5117a1"}
Jul 27 20:56:24.792390 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.792335    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:24.793742 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.793721    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl" event={"ID":"8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01","Type":"ContainerStarted","Data":"c96bee4ac196dcf0b088c9ff6e9df2c5c7c60fe1680d2064f1d407878cfdf2ee"}
Jul 27 20:56:24.795115 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.795089    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd" event={"ID":"3213cdbc-081d-433e-a695-036f51ae5da7","Type":"ContainerStarted","Data":"66c02eb83e572962e0ff48afbca74049550f8828842d73eaed482300a76c7b25"}
Jul 27 20:56:24.795257 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.795238    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:24.829009 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.828958    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv" podStartSLOduration=2.901075303 podStartE2EDuration="6.828940563s" totalImagesPullingTime="3.92786526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:24.827856021 +0000 UTC m=+311.124187341" watchObservedRunningTime="2026-07-27 20:56:24.828940563 +0000 UTC m=+311.125271880"
Jul 27 20:56:24.853665 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.853609    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f4ccdc5cb-45zfl" podStartSLOduration=2.075049361 podStartE2EDuration="6.85359358s" totalImagesPullingTime="4.778544219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:24.852976068 +0000 UTC m=+311.149307386" watchObservedRunningTime="2026-07-27 20:56:24.85359358 +0000 UTC m=+311.149924901"
Jul 27 20:56:24.887803 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:24.887744    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd" podStartSLOduration=1.812857938 podStartE2EDuration="4.887723111s" totalImagesPullingTime="3.074865173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:24.886099871 +0000 UTC m=+311.182431183" watchObservedRunningTime="2026-07-27 20:56:24.887723111 +0000 UTC m=+311.184054431"
Jul 27 20:56:27.031803 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:27.031758    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:56:27.032185 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:27.031828    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:56:27.814209 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:27.814176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb" event={"ID":"0d67941d-a273-4e64-9053-d63af5e19db0","Type":"ContainerStarted","Data":"9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7"}
Jul 27 20:56:27.814424 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:27.814310    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:27.909946 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:27.909886    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb" podStartSLOduration=4.990288499 podStartE2EDuration="7.909866988s" totalImagesPullingTime="2.919578489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:27.876872093 +0000 UTC m=+314.173203411" watchObservedRunningTime="2026-07-27 20:56:27.909866988 +0000 UTC m=+314.206198306"
Jul 27 20:56:28.820669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:28.820642    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:29.856636 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:29.856602    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"]
Jul 27 20:56:29.858959 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:29.858939    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:29.933852 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:29.933818    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"]
Jul 27 20:56:30.050986 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.050948    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.051166 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.051007    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62739725-1733-47cd-9dfc-c42c1a6ce489-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.051166 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.051051    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.051166 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.051080    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.051166 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.051149    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxsst\" (UniqueName: \"kubernetes.io/projected/62739725-1733-47cd-9dfc-c42c1a6ce489-kube-api-access-cxsst\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.051323 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.051188    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.051323 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.051212    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.152361 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.152256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.152361 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.152320    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62739725-1733-47cd-9dfc-c42c1a6ce489-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.152361 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.152361    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.152675 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.152389    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.152675 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.152516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxsst\" (UniqueName: \"kubernetes.io/projected/62739725-1733-47cd-9dfc-c42c1a6ce489-kube-api-access-cxsst\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.152675 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.152606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.152675 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.152661    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.153278 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.153253    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.155138 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.155107    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.155357 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.155335    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/62739725-1733-47cd-9dfc-c42c1a6ce489-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.155438 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.155344    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.155609 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.155591    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/62739725-1733-47cd-9dfc-c42c1a6ce489-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.168886 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.168859    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxsst\" (UniqueName: \"kubernetes.io/projected/62739725-1733-47cd-9dfc-c42c1a6ce489-kube-api-access-cxsst\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.169089 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.169065    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62739725-1733-47cd-9dfc-c42c1a6ce489-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x4g98\" (UID: \"62739725-1733-47cd-9dfc-c42c1a6ce489\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.468373 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.468287    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.648682 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.648656    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"]
Jul 27 20:56:30.650374 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:56:30.650347    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62739725_1733_47cd_9dfc_c42c1a6ce489.slice/crio-3a0e3bdd5756e5ef9c587574417fc5af2b74815e52f20793286312f4aea3906c WatchSource:0}: Error finding container 3a0e3bdd5756e5ef9c587574417fc5af2b74815e52f20793286312f4aea3906c: Status 404 returned error can't find the container with id 3a0e3bdd5756e5ef9c587574417fc5af2b74815e52f20793286312f4aea3906c
Jul 27 20:56:30.653420 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.653383    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:56:30.653506 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.653454    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:56:30.830943 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.830886    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98" event={"ID":"62739725-1733-47cd-9dfc-c42c1a6ce489","Type":"ContainerStarted","Data":"396af0e7a8afdbd1e0f33146e92811a5fcb0b220aabbcef0a9624cd832f7e003"}
Jul 27 20:56:30.831131 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.830961    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98" event={"ID":"62739725-1733-47cd-9dfc-c42c1a6ce489","Type":"ContainerStarted","Data":"3a0e3bdd5756e5ef9c587574417fc5af2b74815e52f20793286312f4aea3906c"}
Jul 27 20:56:30.831223 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.831126    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:30.879288 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:30.879230    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98" podStartSLOduration=1.879215082 podStartE2EDuration="1.879215082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:30.876765083 +0000 UTC m=+317.173096420" watchObservedRunningTime="2026-07-27 20:56:30.879215082 +0000 UTC m=+317.175546400"
Jul 27 20:56:31.836740 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:31.836711    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x4g98"
Jul 27 20:56:31.977942 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:31.977911    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"]
Jul 27 20:56:31.978397 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:31.978120    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb" podUID="0d67941d-a273-4e64-9053-d63af5e19db0" containerName="discovery" containerID="cri-o://9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7" gracePeriod=30
Jul 27 20:56:32.234495 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.234466    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:32.272486 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272436    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsdz4\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-kube-api-access-wsdz4\") pod \"0d67941d-a273-4e64-9053-d63af5e19db0\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") "
Jul 27 20:56:32.272486 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272492    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-istio-token\") pod \"0d67941d-a273-4e64-9053-d63af5e19db0\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") "
Jul 27 20:56:32.272741 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272516    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-ca-configmap\") pod \"0d67941d-a273-4e64-9053-d63af5e19db0\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") "
Jul 27 20:56:32.272741 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272554    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-kubeconfig\") pod \"0d67941d-a273-4e64-9053-d63af5e19db0\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") "
Jul 27 20:56:32.272741 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272670    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d67941d-a273-4e64-9053-d63af5e19db0-local-certs\") pod \"0d67941d-a273-4e64-9053-d63af5e19db0\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") "
Jul 27 20:56:32.272741 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272718    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-dns-cert\") pod \"0d67941d-a273-4e64-9053-d63af5e19db0\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") "
Jul 27 20:56:32.272942 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272800    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-cacerts\") pod \"0d67941d-a273-4e64-9053-d63af5e19db0\" (UID: \"0d67941d-a273-4e64-9053-d63af5e19db0\") "
Jul 27 20:56:32.272995 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.272961    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0d67941d-a273-4e64-9053-d63af5e19db0" (UID: "0d67941d-a273-4e64-9053-d63af5e19db0"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:56:32.273174 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.273139    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-ca-configmap\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:56:32.275642 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.275600    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0d67941d-a273-4e64-9053-d63af5e19db0" (UID: "0d67941d-a273-4e64-9053-d63af5e19db0"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:56:32.275642 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.275600    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d67941d-a273-4e64-9053-d63af5e19db0-local-certs" (OuterVolumeSpecName: "local-certs") pod "0d67941d-a273-4e64-9053-d63af5e19db0" (UID: "0d67941d-a273-4e64-9053-d63af5e19db0"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:56:32.275820 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.275670    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0d67941d-a273-4e64-9053-d63af5e19db0" (UID: "0d67941d-a273-4e64-9053-d63af5e19db0"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:56:32.275820 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.275681    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-kube-api-access-wsdz4" (OuterVolumeSpecName: "kube-api-access-wsdz4") pod "0d67941d-a273-4e64-9053-d63af5e19db0" (UID: "0d67941d-a273-4e64-9053-d63af5e19db0"). InnerVolumeSpecName "kube-api-access-wsdz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:56:32.275820 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.275723    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d67941d-a273-4e64-9053-d63af5e19db0" (UID: "0d67941d-a273-4e64-9053-d63af5e19db0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:56:32.275820 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.275775    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-cacerts" (OuterVolumeSpecName: "cacerts") pod "0d67941d-a273-4e64-9053-d63af5e19db0" (UID: "0d67941d-a273-4e64-9053-d63af5e19db0"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:56:32.373619 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.373503    2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-cacerts\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:56:32.373619 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.373560    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsdz4\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-kube-api-access-wsdz4\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:56:32.373619 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.373588    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d67941d-a273-4e64-9053-d63af5e19db0-istio-token\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:56:32.373619 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.373597    2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-kubeconfig\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:56:32.373619 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.373605    2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d67941d-a273-4e64-9053-d63af5e19db0-local-certs\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:56:32.373619 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.373613    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d67941d-a273-4e64-9053-d63af5e19db0-istio-csr-dns-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:56:32.841326 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.841291    2566 generic.go:356] "Generic (PLEG): container finished" podID="0d67941d-a273-4e64-9053-d63af5e19db0" containerID="9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7" exitCode=0
Jul 27 20:56:32.841488 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.841333    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"
Jul 27 20:56:32.841488 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.841373    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb" event={"ID":"0d67941d-a273-4e64-9053-d63af5e19db0","Type":"ContainerDied","Data":"9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7"}
Jul 27 20:56:32.841488 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.841420    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb" event={"ID":"0d67941d-a273-4e64-9053-d63af5e19db0","Type":"ContainerDied","Data":"5072adf164ab34d97f72108c7f7259f339f148e63e8a64e09287aa80c1143081"}
Jul 27 20:56:32.841488 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.841439    2566 scope.go:117] "RemoveContainer" containerID="9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7"
Jul 27 20:56:32.850432 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.850414    2566 scope.go:117] "RemoveContainer" containerID="9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7"
Jul 27 20:56:32.850720 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:56:32.850700    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7\": container with ID starting with 9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7 not found: ID does not exist" containerID="9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7"
Jul 27 20:56:32.850765 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.850732    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7"} err="failed to get container status \"9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7\": rpc error: code = NotFound desc = could not find container \"9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7\": container with ID starting with 9104e1aa5457de02fd3bf82285fe03c3a023441e56cfa11d21951c1c2c1ad5a7 not found: ID does not exist"
Jul 27 20:56:32.885203 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.885167    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"]
Jul 27 20:56:32.889893 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:32.889864    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vjqqb"]
Jul 27 20:56:34.242830 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:34.242791    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d67941d-a273-4e64-9053-d63af5e19db0" path="/var/lib/kubelet/pods/0d67941d-a273-4e64-9053-d63af5e19db0/volumes"
Jul 27 20:56:35.722175 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.722140    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"]
Jul 27 20:56:35.722596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.722479    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d67941d-a273-4e64-9053-d63af5e19db0" containerName="discovery"
Jul 27 20:56:35.722596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.722490    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d67941d-a273-4e64-9053-d63af5e19db0" containerName="discovery"
Jul 27 20:56:35.722596 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.722595    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d67941d-a273-4e64-9053-d63af5e19db0" containerName="discovery"
Jul 27 20:56:35.724342 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.724326    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:35.739789 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.739767    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 20:56:35.743831 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.743806    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-chmcr\""
Jul 27 20:56:35.802660 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.802631    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7wjzv"
Jul 27 20:56:35.802967 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.802946    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdrdl\" (UniqueName: \"kubernetes.io/projected/2c50b14f-c502-495f-b359-4805148edb9f-kube-api-access-qdrdl\") pod \"kserve-controller-manager-d6f4b65b8-9lsj5\" (UID: \"2c50b14f-c502-495f-b359-4805148edb9f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:35.803026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.802985    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c50b14f-c502-495f-b359-4805148edb9f-cert\") pod \"kserve-controller-manager-d6f4b65b8-9lsj5\" (UID: \"2c50b14f-c502-495f-b359-4805148edb9f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:35.804619 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.804601    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sdcbd"
Jul 27 20:56:35.860648 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.860616    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"]
Jul 27 20:56:35.903809 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.903769    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdrdl\" (UniqueName: \"kubernetes.io/projected/2c50b14f-c502-495f-b359-4805148edb9f-kube-api-access-qdrdl\") pod \"kserve-controller-manager-d6f4b65b8-9lsj5\" (UID: \"2c50b14f-c502-495f-b359-4805148edb9f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:35.903809 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.903802    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c50b14f-c502-495f-b359-4805148edb9f-cert\") pod \"kserve-controller-manager-d6f4b65b8-9lsj5\" (UID: \"2c50b14f-c502-495f-b359-4805148edb9f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:35.906680 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.906646    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c50b14f-c502-495f-b359-4805148edb9f-cert\") pod \"kserve-controller-manager-d6f4b65b8-9lsj5\" (UID: \"2c50b14f-c502-495f-b359-4805148edb9f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:35.946802 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:35.946772    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdrdl\" (UniqueName: \"kubernetes.io/projected/2c50b14f-c502-495f-b359-4805148edb9f-kube-api-access-qdrdl\") pod \"kserve-controller-manager-d6f4b65b8-9lsj5\" (UID: \"2c50b14f-c502-495f-b359-4805148edb9f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:36.033951 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:36.033915    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:36.327052 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:36.327022    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"]
Jul 27 20:56:36.329932 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:56:36.329893    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c50b14f_c502_495f_b359_4805148edb9f.slice/crio-67d28e423a6a0d332982af6467fde569e8279b94131bd0503eb6ef0e1166159a WatchSource:0}: Error finding container 67d28e423a6a0d332982af6467fde569e8279b94131bd0503eb6ef0e1166159a: Status 404 returned error can't find the container with id 67d28e423a6a0d332982af6467fde569e8279b94131bd0503eb6ef0e1166159a
Jul 27 20:56:36.863277 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:36.863243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5" event={"ID":"2c50b14f-c502-495f-b359-4805148edb9f","Type":"ContainerStarted","Data":"67d28e423a6a0d332982af6467fde569e8279b94131bd0503eb6ef0e1166159a"}
Jul 27 20:56:38.877850 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:38.877812    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5" event={"ID":"2c50b14f-c502-495f-b359-4805148edb9f","Type":"ContainerStarted","Data":"4fbc8c95f29e19427549539f0864c74b78d6d845b2b4d95f1c654461ef138c20"}
Jul 27 20:56:38.878203 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:38.877954    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:56:38.964851 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:56:38.964752    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5" podStartSLOduration=1.615288875 podStartE2EDuration="3.964735967s" totalImagesPullingTime="2.349447092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:56:38.963409525 +0000 UTC m=+325.259740848" watchObservedRunningTime="2026-07-27 20:56:38.964735967 +0000 UTC m=+325.261067285"
Jul 27 20:57:09.888155 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:09.888123    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9lsj5"
Jul 27 20:57:34.956167 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:34.956122    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"]
Jul 27 20:57:34.963189 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:34.963152    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:34.976357 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:34.976268    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:57:34.976526 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:34.976272    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t6w6q\""
Jul 27 20:57:34.976785 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:34.976765    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:57:34.978669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:34.978644    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"]
Jul 27 20:57:35.017838 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.017792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8xm\" (UniqueName: \"kubernetes.io/projected/5159abf3-0759-4c67-9fcd-24ce4b08ee41-kube-api-access-wn8xm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.018008 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.017860    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.018008 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.017904    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.118801 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.118741    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8xm\" (UniqueName: \"kubernetes.io/projected/5159abf3-0759-4c67-9fcd-24ce4b08ee41-kube-api-access-wn8xm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.118801 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.118802    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.119069 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.118861    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.119254 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.119231    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.119317 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.119267    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.127511 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.127484    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8xm\" (UniqueName: \"kubernetes.io/projected/5159abf3-0759-4c67-9fcd-24ce4b08ee41-kube-api-access-wn8xm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.285138 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.285103    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:35.366622 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.366521    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"]
Jul 27 20:57:35.370799 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.370775    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.379137 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.379006    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"]
Jul 27 20:57:35.421998 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.421956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4h6\" (UniqueName: \"kubernetes.io/projected/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-kube-api-access-pl4h6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.422198 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.422103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.422198 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.422151    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.430361 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.430332    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"]
Jul 27 20:57:35.432627 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:57:35.432589    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5159abf3_0759_4c67_9fcd_24ce4b08ee41.slice/crio-8c7a66b7501b3140665888d411851171c32302dedc6cc6ac422b3fc1d7cc71c2 WatchSource:0}: Error finding container 8c7a66b7501b3140665888d411851171c32302dedc6cc6ac422b3fc1d7cc71c2: Status 404 returned error can't find the container with id 8c7a66b7501b3140665888d411851171c32302dedc6cc6ac422b3fc1d7cc71c2
Jul 27 20:57:35.523200 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.523158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.523200 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.523202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.523434 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.523279    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4h6\" (UniqueName: \"kubernetes.io/projected/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-kube-api-access-pl4h6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.523676 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.523641    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.523831 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.523808    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.533807 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.533773    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4h6\" (UniqueName: \"kubernetes.io/projected/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-kube-api-access-pl4h6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.687401 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.687361    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:35.827975 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:35.827949    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"]
Jul 27 20:57:35.830108 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:57:35.830076    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff2ef69_bef6_4685_9e95_6fd35e0cb52a.slice/crio-dc9d7df7a1c83f6f8df3f2ad285665bac6693176f44183af468a076f1e4826d3 WatchSource:0}: Error finding container dc9d7df7a1c83f6f8df3f2ad285665bac6693176f44183af468a076f1e4826d3: Status 404 returned error can't find the container with id dc9d7df7a1c83f6f8df3f2ad285665bac6693176f44183af468a076f1e4826d3
Jul 27 20:57:36.162403 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:36.162370    2566 generic.go:356] "Generic (PLEG): container finished" podID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerID="3fbdc83c305f81e0ecbc3b3c4aa960ee5e8f1bebe839327041e7da4bb4a09590" exitCode=0
Jul 27 20:57:36.162875 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:36.162459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz" event={"ID":"5159abf3-0759-4c67-9fcd-24ce4b08ee41","Type":"ContainerDied","Data":"3fbdc83c305f81e0ecbc3b3c4aa960ee5e8f1bebe839327041e7da4bb4a09590"}
Jul 27 20:57:36.162875 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:36.162555    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz" event={"ID":"5159abf3-0759-4c67-9fcd-24ce4b08ee41","Type":"ContainerStarted","Data":"8c7a66b7501b3140665888d411851171c32302dedc6cc6ac422b3fc1d7cc71c2"}
Jul 27 20:57:36.164248 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:36.164215    2566 generic.go:356] "Generic (PLEG): container finished" podID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerID="08532c7870679de1d676ecad910358ad165bba9e26d61b08bd7099c55d44264e" exitCode=0
Jul 27 20:57:36.164349 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:36.164318    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6" event={"ID":"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a","Type":"ContainerDied","Data":"08532c7870679de1d676ecad910358ad165bba9e26d61b08bd7099c55d44264e"}
Jul 27 20:57:36.164392 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:36.164353    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6" event={"ID":"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a","Type":"ContainerStarted","Data":"dc9d7df7a1c83f6f8df3f2ad285665bac6693176f44183af468a076f1e4826d3"}
Jul 27 20:57:37.170880 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:37.170786    2566 generic.go:356] "Generic (PLEG): container finished" podID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerID="7377a35431a99c88e2eafbefa33b5c44940dd0d8a9007d1f9e71896fd4ab60b7" exitCode=0
Jul 27 20:57:37.170880 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:37.170871    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz" event={"ID":"5159abf3-0759-4c67-9fcd-24ce4b08ee41","Type":"ContainerDied","Data":"7377a35431a99c88e2eafbefa33b5c44940dd0d8a9007d1f9e71896fd4ab60b7"}
Jul 27 20:57:37.173009 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:37.172985    2566 generic.go:356] "Generic (PLEG): container finished" podID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerID="1cb5706a464a1b72e9abeed6d993436026d06306b2e71f9d089eb5a26f809f21" exitCode=0
Jul 27 20:57:37.173111 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:37.173033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6" event={"ID":"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a","Type":"ContainerDied","Data":"1cb5706a464a1b72e9abeed6d993436026d06306b2e71f9d089eb5a26f809f21"}
Jul 27 20:57:38.181629 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:38.181590    2566 generic.go:356] "Generic (PLEG): container finished" podID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerID="9c8abb2eff486f19eef269be9d14d3c65ede9178500daffe23894834ceb35eeb" exitCode=0
Jul 27 20:57:38.182049 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:38.181675    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz" event={"ID":"5159abf3-0759-4c67-9fcd-24ce4b08ee41","Type":"ContainerDied","Data":"9c8abb2eff486f19eef269be9d14d3c65ede9178500daffe23894834ceb35eeb"}
Jul 27 20:57:38.183769 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:38.183745    2566 generic.go:356] "Generic (PLEG): container finished" podID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerID="d4fa1d0ec30d3d5ebdbc329e31b63ebdbb7def187e5e44ac3fb5f56f126342a1" exitCode=0
Jul 27 20:57:38.183883 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:38.183782    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6" event={"ID":"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a","Type":"ContainerDied","Data":"d4fa1d0ec30d3d5ebdbc329e31b63ebdbb7def187e5e44ac3fb5f56f126342a1"}
Jul 27 20:57:39.336725 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.336699    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:39.356206 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.356175    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-util\") pod \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") "
Jul 27 20:57:39.356344 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.356262    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl4h6\" (UniqueName: \"kubernetes.io/projected/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-kube-api-access-pl4h6\") pod \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") "
Jul 27 20:57:39.356415 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.356349    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-bundle\") pod \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\" (UID: \"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a\") "
Jul 27 20:57:39.356964 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.356933    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-bundle" (OuterVolumeSpecName: "bundle") pod "4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" (UID: "4ff2ef69-bef6-4685-9e95-6fd35e0cb52a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:39.358949 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.358915    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-kube-api-access-pl4h6" (OuterVolumeSpecName: "kube-api-access-pl4h6") pod "4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" (UID: "4ff2ef69-bef6-4685-9e95-6fd35e0cb52a"). InnerVolumeSpecName "kube-api-access-pl4h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:57:39.364271 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.364217    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-util" (OuterVolumeSpecName: "util") pod "4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" (UID: "4ff2ef69-bef6-4685-9e95-6fd35e0cb52a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:39.378400 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.378373    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:39.457274 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.457162    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-bundle\") pod \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") "
Jul 27 20:57:39.457274 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.457275    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn8xm\" (UniqueName: \"kubernetes.io/projected/5159abf3-0759-4c67-9fcd-24ce4b08ee41-kube-api-access-wn8xm\") pod \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") "
Jul 27 20:57:39.457509 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.457370    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-util\") pod \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\" (UID: \"5159abf3-0759-4c67-9fcd-24ce4b08ee41\") "
Jul 27 20:57:39.457663 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.457646    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-util\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:57:39.457728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.457670    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl4h6\" (UniqueName: \"kubernetes.io/projected/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-kube-api-access-pl4h6\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:57:39.457728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.457686    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff2ef69-bef6-4685-9e95-6fd35e0cb52a-bundle\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:57:39.457795 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.457749    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-bundle" (OuterVolumeSpecName: "bundle") pod "5159abf3-0759-4c67-9fcd-24ce4b08ee41" (UID: "5159abf3-0759-4c67-9fcd-24ce4b08ee41"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:39.459650 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.459624    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5159abf3-0759-4c67-9fcd-24ce4b08ee41-kube-api-access-wn8xm" (OuterVolumeSpecName: "kube-api-access-wn8xm") pod "5159abf3-0759-4c67-9fcd-24ce4b08ee41" (UID: "5159abf3-0759-4c67-9fcd-24ce4b08ee41"). InnerVolumeSpecName "kube-api-access-wn8xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:57:39.462613 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.462592    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-util" (OuterVolumeSpecName: "util") pod "5159abf3-0759-4c67-9fcd-24ce4b08ee41" (UID: "5159abf3-0759-4c67-9fcd-24ce4b08ee41"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:57:39.558482 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.558432    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn8xm\" (UniqueName: \"kubernetes.io/projected/5159abf3-0759-4c67-9fcd-24ce4b08ee41-kube-api-access-wn8xm\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:57:39.558482 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.558476    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-util\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:57:39.558482 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:39.558486    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5159abf3-0759-4c67-9fcd-24ce4b08ee41-bundle\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:57:40.195356 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:40.195326    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6"
Jul 27 20:57:40.195356 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:40.195340    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6" event={"ID":"4ff2ef69-bef6-4685-9e95-6fd35e0cb52a","Type":"ContainerDied","Data":"dc9d7df7a1c83f6f8df3f2ad285665bac6693176f44183af468a076f1e4826d3"}
Jul 27 20:57:40.195665 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:40.195402    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc9d7df7a1c83f6f8df3f2ad285665bac6693176f44183af468a076f1e4826d3"
Jul 27 20:57:40.197301 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:40.197270    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz" event={"ID":"5159abf3-0759-4c67-9fcd-24ce4b08ee41","Type":"ContainerDied","Data":"8c7a66b7501b3140665888d411851171c32302dedc6cc6ac422b3fc1d7cc71c2"}
Jul 27 20:57:40.197301 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:40.197314    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz"
Jul 27 20:57:40.197485 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:40.197323    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c7a66b7501b3140665888d411851171c32302dedc6cc6ac422b3fc1d7cc71c2"
Jul 27 20:57:53.109606 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109573    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"]
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109905    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerName="util"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109916    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerName="util"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109927    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerName="pull"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109933    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerName="pull"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109943    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerName="pull"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109949    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerName="pull"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109961    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerName="extract"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109966    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerName="extract"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109977    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerName="extract"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109982    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerName="extract"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109992    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerName="util"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.109997    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerName="util"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.110047    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff2ef69-bef6-4685-9e95-6fd35e0cb52a" containerName="extract"
Jul 27 20:57:53.110073 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.110055    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5159abf3-0759-4c67-9fcd-24ce4b08ee41" containerName="extract"
Jul 27 20:57:53.113460 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.113442    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.116624 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.116599    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfg2h\""
Jul 27 20:57:53.116967 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.116950    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 20:57:53.117362 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.117346    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 20:57:53.133262 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.133230    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"]
Jul 27 20:57:53.182824 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.182779    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7ed52b-613d-4cdc-a313-7db01069bb0a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.183026 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.182857    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrb6n\" (UniqueName: \"kubernetes.io/projected/3e7ed52b-613d-4cdc-a313-7db01069bb0a-kube-api-access-zrb6n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.283474 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.283435    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrb6n\" (UniqueName: \"kubernetes.io/projected/3e7ed52b-613d-4cdc-a313-7db01069bb0a-kube-api-access-zrb6n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.283682 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.283502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7ed52b-613d-4cdc-a313-7db01069bb0a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.283935 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.283916    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7ed52b-613d-4cdc-a313-7db01069bb0a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.297278 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.297242    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrb6n\" (UniqueName: \"kubernetes.io/projected/3e7ed52b-613d-4cdc-a313-7db01069bb0a-kube-api-access-zrb6n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.424684 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.424651    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:57:53.591923 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:53.591893    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"]
Jul 27 20:57:53.593846 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:57:53.593819    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7ed52b_613d_4cdc_a313_7db01069bb0a.slice/crio-1a4bac8afa67cbc4d82afdb16dbeb0a335c13b7c290b838ab663d7a0c0332276 WatchSource:0}: Error finding container 1a4bac8afa67cbc4d82afdb16dbeb0a335c13b7c290b838ab663d7a0c0332276: Status 404 returned error can't find the container with id 1a4bac8afa67cbc4d82afdb16dbeb0a335c13b7c290b838ab663d7a0c0332276
Jul 27 20:57:54.263889 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.263843    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn" event={"ID":"3e7ed52b-613d-4cdc-a313-7db01069bb0a","Type":"ContainerStarted","Data":"1a4bac8afa67cbc4d82afdb16dbeb0a335c13b7c290b838ab663d7a0c0332276"}
Jul 27 20:57:54.651871 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.651786    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97bd5758d-9kxns"]
Jul 27 20:57:54.655301 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.655271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.685030 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.684987    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97bd5758d-9kxns"]
Jul 27 20:57:54.797300 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.797253    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-config\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.797300 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.797305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-service-ca\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.797618 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.797371    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-oauth-serving-cert\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.797618 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.797407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-serving-cert\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.797618 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.797477    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xpsd\" (UniqueName: \"kubernetes.io/projected/1f679df2-b325-49b5-9e01-bb72e88dfa36-kube-api-access-4xpsd\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.797618 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.797508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-oauth-config\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.797618 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.797574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-trusted-ca-bundle\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.899311 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.899261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-oauth-serving-cert\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.899509 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.899354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-serving-cert\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.899509 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.899449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xpsd\" (UniqueName: \"kubernetes.io/projected/1f679df2-b325-49b5-9e01-bb72e88dfa36-kube-api-access-4xpsd\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.899509 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.899473    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-oauth-config\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.899509 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.899499    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-trusted-ca-bundle\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.899755 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.899582    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-config\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.900090 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.900065    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-oauth-serving-cert\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.900184 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.900123    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-service-ca\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.900471 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.900259    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-config\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.900828 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.900788    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-service-ca\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.900828 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.900799    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f679df2-b325-49b5-9e01-bb72e88dfa36-trusted-ca-bundle\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.904340 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.904233    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-oauth-config\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.905014 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.904968    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f679df2-b325-49b5-9e01-bb72e88dfa36-console-serving-cert\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.915525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.915490    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xpsd\" (UniqueName: \"kubernetes.io/projected/1f679df2-b325-49b5-9e01-bb72e88dfa36-kube-api-access-4xpsd\") pod \"console-97bd5758d-9kxns\" (UID: \"1f679df2-b325-49b5-9e01-bb72e88dfa36\") " pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:54.967943 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:54.967899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:57:55.265057 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:55.264985    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97bd5758d-9kxns"]
Jul 27 20:57:55.268733 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:57:55.268670    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f679df2_b325_49b5_9e01_bb72e88dfa36.slice/crio-a13c3476c43277ec3c12b964917b62915215e4ead2574e707337d86cc06501ed WatchSource:0}: Error finding container a13c3476c43277ec3c12b964917b62915215e4ead2574e707337d86cc06501ed: Status 404 returned error can't find the container with id a13c3476c43277ec3c12b964917b62915215e4ead2574e707337d86cc06501ed
Jul 27 20:57:56.281754 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:56.281716    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bd5758d-9kxns" event={"ID":"1f679df2-b325-49b5-9e01-bb72e88dfa36","Type":"ContainerStarted","Data":"70cc0e83bcbeeb0d6ac6a9e78d780d2b61bba621a05fa5beabe6297c0f8b66bf"}
Jul 27 20:57:56.282252 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:56.281788    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bd5758d-9kxns" event={"ID":"1f679df2-b325-49b5-9e01-bb72e88dfa36","Type":"ContainerStarted","Data":"a13c3476c43277ec3c12b964917b62915215e4ead2574e707337d86cc06501ed"}
Jul 27 20:57:56.341470 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:57:56.341414    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97bd5758d-9kxns" podStartSLOduration=2.341398853 podStartE2EDuration="2.341398853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:56.336385191 +0000 UTC m=+402.632716510" watchObservedRunningTime="2026-07-27 20:57:56.341398853 +0000 UTC m=+402.637730170"
Jul 27 20:58:00.305685 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:00.305643    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn" event={"ID":"3e7ed52b-613d-4cdc-a313-7db01069bb0a","Type":"ContainerStarted","Data":"6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd"}
Jul 27 20:58:00.306095 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:00.305777    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:58:00.336473 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:00.336416    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn" podStartSLOduration=1.6128390110000002 podStartE2EDuration="7.336396053s" totalImagesPullingTime="5.723557042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:00.334509248 +0000 UTC m=+406.630840607" watchObservedRunningTime="2026-07-27 20:58:00.336396053 +0000 UTC m=+406.632727470"
Jul 27 20:58:04.969251 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:04.969207    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:58:04.969783 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:04.969279    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:58:04.974379 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:04.974354    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:58:05.334657 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:05.334626    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97bd5758d-9kxns"
Jul 27 20:58:05.380751 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:05.380654    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568bf86c9b-zjcz4"]
Jul 27 20:58:11.313443 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:11.313412    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:58:13.357828 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.357793    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"]
Jul 27 20:58:13.358232 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.357991    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" containerName="manager" containerID="cri-o://6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd" gracePeriod=2
Jul 27 20:58:13.380761 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.380736    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"]
Jul 27 20:58:13.495080 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.495034    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"]
Jul 27 20:58:13.495672 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.495643    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" containerName="manager"
Jul 27 20:58:13.495672 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.495671    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" containerName="manager"
Jul 27 20:58:13.495883 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.495760    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" containerName="manager"
Jul 27 20:58:13.498376 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.498351    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.506919 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:58:13.506870    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:58:13.538215 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.538179    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"]
Jul 27 20:58:13.580145 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.580108    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vlv5\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.580320 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.580167    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr5hw\" (UniqueName: \"kubernetes.io/projected/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-kube-api-access-hr5hw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vlv5\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.633297 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.633271    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:58:13.638014 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:58:13.637978    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:58:13.680987 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.680951    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vlv5\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.680987 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.680997    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr5hw\" (UniqueName: \"kubernetes.io/projected/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-kube-api-access-hr5hw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vlv5\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.681353 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.681330    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vlv5\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.699820 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.699790    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr5hw\" (UniqueName: \"kubernetes.io/projected/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-kube-api-access-hr5hw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vlv5\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.781925 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.781890    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7ed52b-613d-4cdc-a313-7db01069bb0a-extensions-socket-volume\") pod \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") "
Jul 27 20:58:13.782141 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.781993    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrb6n\" (UniqueName: \"kubernetes.io/projected/3e7ed52b-613d-4cdc-a313-7db01069bb0a-kube-api-access-zrb6n\") pod \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\" (UID: \"3e7ed52b-613d-4cdc-a313-7db01069bb0a\") "
Jul 27 20:58:13.782454 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.782428    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e7ed52b-613d-4cdc-a313-7db01069bb0a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3e7ed52b-613d-4cdc-a313-7db01069bb0a" (UID: "3e7ed52b-613d-4cdc-a313-7db01069bb0a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:13.784329 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.784305    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e7ed52b-613d-4cdc-a313-7db01069bb0a-kube-api-access-zrb6n" (OuterVolumeSpecName: "kube-api-access-zrb6n") pod "3e7ed52b-613d-4cdc-a313-7db01069bb0a" (UID: "3e7ed52b-613d-4cdc-a313-7db01069bb0a"). InnerVolumeSpecName "kube-api-access-zrb6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:13.809661 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.809631    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:13.882799 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.882767    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e7ed52b-613d-4cdc-a313-7db01069bb0a-extensions-socket-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:13.882799 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.882796    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrb6n\" (UniqueName: \"kubernetes.io/projected/3e7ed52b-613d-4cdc-a313-7db01069bb0a-kube-api-access-zrb6n\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:13.980155 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:13.980131    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"]
Jul 27 20:58:13.983199 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:58:13.983166    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e28347_9513_45fe_9a4e_c85c6ee1c3e7.slice/crio-c551bd3261553096af428327353c246b8fdd83afe190a265182e1c9d8a6b35d6 WatchSource:0}: Error finding container c551bd3261553096af428327353c246b8fdd83afe190a265182e1c9d8a6b35d6: Status 404 returned error can't find the container with id c551bd3261553096af428327353c246b8fdd83afe190a265182e1c9d8a6b35d6
Jul 27 20:58:14.242525 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:58:14.242491    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vl4fn\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:58:14.243937 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.243916    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" path="/var/lib/kubelet/pods/3e7ed52b-613d-4cdc-a313-7db01069bb0a/volumes"
Jul 27 20:58:14.381149 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.381111    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5" event={"ID":"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7","Type":"ContainerStarted","Data":"ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5"}
Jul 27 20:58:14.381591 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.381165    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5" event={"ID":"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7","Type":"ContainerStarted","Data":"c551bd3261553096af428327353c246b8fdd83afe190a265182e1c9d8a6b35d6"}
Jul 27 20:58:14.381591 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.381208    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:14.382695 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.382669    2566 generic.go:356] "Generic (PLEG): container finished" podID="3e7ed52b-613d-4cdc-a313-7db01069bb0a" containerID="6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd" exitCode=0
Jul 27 20:58:14.382768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.382712    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vl4fn"
Jul 27 20:58:14.382768 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.382750    2566 scope.go:117] "RemoveContainer" containerID="6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd"
Jul 27 20:58:14.392060 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.392042    2566 scope.go:117] "RemoveContainer" containerID="6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd"
Jul 27 20:58:14.392373 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:58:14.392353    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd\": container with ID starting with 6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd not found: ID does not exist" containerID="6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd"
Jul 27 20:58:14.392451 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.392382    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd"} err="failed to get container status \"6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd\": rpc error: code = NotFound desc = could not find container \"6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd\": container with ID starting with 6819b2333449dacb7cf8f7b2d2f21e2ac6b8f6f9b7d5ee3efadb9fdf7a61c6cd not found: ID does not exist"
Jul 27 20:58:14.431782 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:14.431722    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5" podStartSLOduration=1.431706631 podStartE2EDuration="1.431706631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:14.430720129 +0000 UTC m=+420.727051447" watchObservedRunningTime="2026-07-27 20:58:14.431706631 +0000 UTC m=+420.728037948"
Jul 27 20:58:15.690208 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.690124    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"]
Jul 27 20:58:15.693570 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.693527    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:15.762174 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.762137    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"]
Jul 27 20:58:15.800008 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.799966    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c43fe161-467c-4ffd-9f3a-f95a024deb3c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gv6w9\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:15.800008 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.800006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l44fs\" (UniqueName: \"kubernetes.io/projected/c43fe161-467c-4ffd-9f3a-f95a024deb3c-kube-api-access-l44fs\") pod \"kuadrant-operator-controller-manager-86878c769f-gv6w9\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:15.900686 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.900640    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c43fe161-467c-4ffd-9f3a-f95a024deb3c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gv6w9\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:15.900686 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.900681    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l44fs\" (UniqueName: \"kubernetes.io/projected/c43fe161-467c-4ffd-9f3a-f95a024deb3c-kube-api-access-l44fs\") pod \"kuadrant-operator-controller-manager-86878c769f-gv6w9\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:15.901090 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.901070    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c43fe161-467c-4ffd-9f3a-f95a024deb3c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gv6w9\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:15.960461 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:15.960386    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l44fs\" (UniqueName: \"kubernetes.io/projected/c43fe161-467c-4ffd-9f3a-f95a024deb3c-kube-api-access-l44fs\") pod \"kuadrant-operator-controller-manager-86878c769f-gv6w9\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:16.004066 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:16.004024    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:16.165293 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:16.165268    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"]
Jul 27 20:58:16.167335 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:58:16.167311    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43fe161_467c_4ffd_9f3a_f95a024deb3c.slice/crio-ed7d3d0ca367f369750d26f39eef9d25cafeb297565dd0c7fa21177dc5634265 WatchSource:0}: Error finding container ed7d3d0ca367f369750d26f39eef9d25cafeb297565dd0c7fa21177dc5634265: Status 404 returned error can't find the container with id ed7d3d0ca367f369750d26f39eef9d25cafeb297565dd0c7fa21177dc5634265
Jul 27 20:58:16.394601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:16.394528    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9" event={"ID":"c43fe161-467c-4ffd-9f3a-f95a024deb3c","Type":"ContainerStarted","Data":"cef28b288601655a08721fc9e42fedc35b66bd4f3ef2180f3923dcb1e92200f9"}
Jul 27 20:58:16.394864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:16.394626    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:16.394864 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:16.394648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9" event={"ID":"c43fe161-467c-4ffd-9f3a-f95a024deb3c","Type":"ContainerStarted","Data":"ed7d3d0ca367f369750d26f39eef9d25cafeb297565dd0c7fa21177dc5634265"}
Jul 27 20:58:16.434258 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:16.434184    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9" podStartSLOduration=1.434160617 podStartE2EDuration="1.434160617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:16.432830694 +0000 UTC m=+422.729162035" watchObservedRunningTime="2026-07-27 20:58:16.434160617 +0000 UTC m=+422.730491935"
Jul 27 20:58:25.390322 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:25.390283    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:27.409099 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.409069    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 20:58:27.466375 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.466340    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"]
Jul 27 20:58:27.466592 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.466521    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5" podUID="b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" containerName="manager" containerID="cri-o://ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5" gracePeriod=10
Jul 27 20:58:27.725947 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.725917    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:27.803738 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.803696    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr5hw\" (UniqueName: \"kubernetes.io/projected/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-kube-api-access-hr5hw\") pod \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") "
Jul 27 20:58:27.803935 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.803751    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-extensions-socket-volume\") pod \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\" (UID: \"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7\") "
Jul 27 20:58:27.804174 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.804137    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" (UID: "b8e28347-9513-45fe-9a4e-c85c6ee1c3e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:58:27.806083 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.806058    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-kube-api-access-hr5hw" (OuterVolumeSpecName: "kube-api-access-hr5hw") pod "b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" (UID: "b8e28347-9513-45fe-9a4e-c85c6ee1c3e7"). InnerVolumeSpecName "kube-api-access-hr5hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:27.904784 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.904741    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr5hw\" (UniqueName: \"kubernetes.io/projected/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-kube-api-access-hr5hw\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:27.904784 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:27.904774    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7-extensions-socket-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:28.463361 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.463313    2566 generic.go:356] "Generic (PLEG): container finished" podID="b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" containerID="ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5" exitCode=0
Jul 27 20:58:28.463863 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.463377    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"
Jul 27 20:58:28.463863 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.463405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5" event={"ID":"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7","Type":"ContainerDied","Data":"ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5"}
Jul 27 20:58:28.463863 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.463474    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5" event={"ID":"b8e28347-9513-45fe-9a4e-c85c6ee1c3e7","Type":"ContainerDied","Data":"c551bd3261553096af428327353c246b8fdd83afe190a265182e1c9d8a6b35d6"}
Jul 27 20:58:28.463863 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.463510    2566 scope.go:117] "RemoveContainer" containerID="ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5"
Jul 27 20:58:28.472835 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.472623    2566 scope.go:117] "RemoveContainer" containerID="ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5"
Jul 27 20:58:28.472958 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:58:28.472939    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5\": container with ID starting with ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5 not found: ID does not exist" containerID="ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5"
Jul 27 20:58:28.473004 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.472968    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5"} err="failed to get container status \"ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5\": rpc error: code = NotFound desc = could not find container \"ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5\": container with ID starting with ea2359eaccd05b8dc48b5fe07eb20559c5ade2fa881c96025b47d4eb60609ad5 not found: ID does not exist"
Jul 27 20:58:28.485611 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.485577    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"]
Jul 27 20:58:28.491598 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:28.491568    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vlv5"]
Jul 27 20:58:30.243027 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.242993    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" path="/var/lib/kubelet/pods/b8e28347-9513-45fe-9a4e-c85c6ee1c3e7/volumes"
Jul 27 20:58:30.406669 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.406630    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-568bf86c9b-zjcz4" podUID="fe05d26d-8eca-421a-ac5d-1ab0f65f2423" containerName="console" containerID="cri-o://a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385" gracePeriod=15
Jul 27 20:58:30.658095 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.658065    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:58:30.728281 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728240    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-service-ca\") pod \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") "
Jul 27 20:58:30.728453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728312    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-trusted-ca-bundle\") pod \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") "
Jul 27 20:58:30.728453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728338    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-serving-cert\") pod \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") "
Jul 27 20:58:30.728453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728371    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgpvs\" (UniqueName: \"kubernetes.io/projected/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-kube-api-access-hgpvs\") pod \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") "
Jul 27 20:58:30.728453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728396    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-oauth-config\") pod \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") "
Jul 27 20:58:30.728453 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728434    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-config\") pod \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") "
Jul 27 20:58:30.728753 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728472    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-oauth-serving-cert\") pod \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\" (UID: \"fe05d26d-8eca-421a-ac5d-1ab0f65f2423\") "
Jul 27 20:58:30.728838 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728806    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe05d26d-8eca-421a-ac5d-1ab0f65f2423" (UID: "fe05d26d-8eca-421a-ac5d-1ab0f65f2423"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:30.729024 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.728943    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe05d26d-8eca-421a-ac5d-1ab0f65f2423" (UID: "fe05d26d-8eca-421a-ac5d-1ab0f65f2423"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:30.729024 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.729007    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-config" (OuterVolumeSpecName: "console-config") pod "fe05d26d-8eca-421a-ac5d-1ab0f65f2423" (UID: "fe05d26d-8eca-421a-ac5d-1ab0f65f2423"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:30.729137 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.729002    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe05d26d-8eca-421a-ac5d-1ab0f65f2423" (UID: "fe05d26d-8eca-421a-ac5d-1ab0f65f2423"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:58:30.730739 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.730706    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-kube-api-access-hgpvs" (OuterVolumeSpecName: "kube-api-access-hgpvs") pod "fe05d26d-8eca-421a-ac5d-1ab0f65f2423" (UID: "fe05d26d-8eca-421a-ac5d-1ab0f65f2423"). InnerVolumeSpecName "kube-api-access-hgpvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:58:30.731269 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.731254    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe05d26d-8eca-421a-ac5d-1ab0f65f2423" (UID: "fe05d26d-8eca-421a-ac5d-1ab0f65f2423"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:58:30.731322 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.731278    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe05d26d-8eca-421a-ac5d-1ab0f65f2423" (UID: "fe05d26d-8eca-421a-ac5d-1ab0f65f2423"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:58:30.829728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.829637    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-oauth-serving-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:30.829728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.829669    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:30.829728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.829678    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-trusted-ca-bundle\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:30.829728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.829686    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-serving-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:30.829728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.829695    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgpvs\" (UniqueName: \"kubernetes.io/projected/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-kube-api-access-hgpvs\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:30.829728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.829704    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-oauth-config\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:30.829728 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:30.829713    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe05d26d-8eca-421a-ac5d-1ab0f65f2423-console-config\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:58:31.481542 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.481511    2566 generic.go:356] "Generic (PLEG): container finished" podID="fe05d26d-8eca-421a-ac5d-1ab0f65f2423" containerID="a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385" exitCode=0
Jul 27 20:58:31.481978 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.481575    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bf86c9b-zjcz4"
Jul 27 20:58:31.481978 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.481585    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bf86c9b-zjcz4" event={"ID":"fe05d26d-8eca-421a-ac5d-1ab0f65f2423","Type":"ContainerDied","Data":"a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385"}
Jul 27 20:58:31.481978 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.481628    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bf86c9b-zjcz4" event={"ID":"fe05d26d-8eca-421a-ac5d-1ab0f65f2423","Type":"ContainerDied","Data":"eb2b0d4dfecdf867384f691f200f4e70ea48af118ad258ab361d0e50f62c7fdb"}
Jul 27 20:58:31.481978 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.481648    2566 scope.go:117] "RemoveContainer" containerID="a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385"
Jul 27 20:58:31.491173 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.491156    2566 scope.go:117] "RemoveContainer" containerID="a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385"
Jul 27 20:58:31.491462 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:58:31.491443    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385\": container with ID starting with a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385 not found: ID does not exist" containerID="a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385"
Jul 27 20:58:31.491517 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.491472    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385"} err="failed to get container status \"a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385\": rpc error: code = NotFound desc = could not find container \"a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385\": container with ID starting with a04c9d95f3f59e153a59d3a15edf52dd9eb200e145dfe27567355d0f562f7385 not found: ID does not exist"
Jul 27 20:58:31.508971 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.508939    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568bf86c9b-zjcz4"]
Jul 27 20:58:31.516415 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:31.516383    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568bf86c9b-zjcz4"]
Jul 27 20:58:32.242933 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:32.242899    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe05d26d-8eca-421a-ac5d-1ab0f65f2423" path="/var/lib/kubelet/pods/fe05d26d-8eca-421a-ac5d-1ab0f65f2423/volumes"
Jul 27 20:58:46.115313 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.115227    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"]
Jul 27 20:58:46.115747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.115608    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" containerName="manager"
Jul 27 20:58:46.115747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.115621    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" containerName="manager"
Jul 27 20:58:46.115747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.115646    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe05d26d-8eca-421a-ac5d-1ab0f65f2423" containerName="console"
Jul 27 20:58:46.115747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.115651    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe05d26d-8eca-421a-ac5d-1ab0f65f2423" containerName="console"
Jul 27 20:58:46.115747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.115713    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e28347-9513-45fe-9a4e-c85c6ee1c3e7" containerName="manager"
Jul 27 20:58:46.115747 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.115722    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe05d26d-8eca-421a-ac5d-1ab0f65f2423" containerName="console"
Jul 27 20:58:46.117593 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.117577    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.121625 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.121603    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t6w6q\""
Jul 27 20:58:46.121751 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.121604    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 20:58:46.127601 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.127575    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"]
Jul 27 20:58:46.165019 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.164977    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzxsl\" (UniqueName: \"kubernetes.io/projected/c71a4c33-d129-4615-a8c5-0709d049aaeb-kube-api-access-rzxsl\") pod \"limitador-limitador-64c94fd64f-8jgs2\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.165019 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.165021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c71a4c33-d129-4615-a8c5-0709d049aaeb-config-file\") pod \"limitador-limitador-64c94fd64f-8jgs2\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.213842 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.213797    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"]
Jul 27 20:58:46.266406 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.266365    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzxsl\" (UniqueName: \"kubernetes.io/projected/c71a4c33-d129-4615-a8c5-0709d049aaeb-kube-api-access-rzxsl\") pod \"limitador-limitador-64c94fd64f-8jgs2\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.266406 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.266410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c71a4c33-d129-4615-a8c5-0709d049aaeb-config-file\") pod \"limitador-limitador-64c94fd64f-8jgs2\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.267010 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.266992    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c71a4c33-d129-4615-a8c5-0709d049aaeb-config-file\") pod \"limitador-limitador-64c94fd64f-8jgs2\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.275260 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.275231    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzxsl\" (UniqueName: \"kubernetes.io/projected/c71a4c33-d129-4615-a8c5-0709d049aaeb-kube-api-access-rzxsl\") pod \"limitador-limitador-64c94fd64f-8jgs2\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.429033 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.428928    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:46.575415 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:46.575381    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"]
Jul 27 20:58:46.578646 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:58:46.578614    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71a4c33_d129_4615_a8c5_0709d049aaeb.slice/crio-764cb14f8f5013f7dfc031c08a83699044d3e30165ed58144ea876a1413b2bab WatchSource:0}: Error finding container 764cb14f8f5013f7dfc031c08a83699044d3e30165ed58144ea876a1413b2bab: Status 404 returned error can't find the container with id 764cb14f8f5013f7dfc031c08a83699044d3e30165ed58144ea876a1413b2bab
Jul 27 20:58:47.567756 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:47.567715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2" event={"ID":"c71a4c33-d129-4615-a8c5-0709d049aaeb","Type":"ContainerStarted","Data":"764cb14f8f5013f7dfc031c08a83699044d3e30165ed58144ea876a1413b2bab"}
Jul 27 20:58:49.580813 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:49.580766    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2" event={"ID":"c71a4c33-d129-4615-a8c5-0709d049aaeb","Type":"ContainerStarted","Data":"f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e"}
Jul 27 20:58:49.581251 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:49.580903    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:58:49.598610 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:58:49.598551    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2" podStartSLOduration=0.959920938 podStartE2EDuration="3.598518975s" totalImagesPullingTime="2.638598037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:49.597197886 +0000 UTC m=+455.893529204" watchObservedRunningTime="2026-07-27 20:58:49.598518975 +0000 UTC m=+455.894850294"
Jul 27 20:59:00.586675 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:00.586643    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:59:01.240913 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:01.240873    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"]
Jul 27 20:59:01.241144 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:01.241115    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2" podUID="c71a4c33-d129-4615-a8c5-0709d049aaeb" containerName="limitador" containerID="cri-o://f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e" gracePeriod=30
Jul 27 20:59:01.793623 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:01.793598    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:59:01.911893 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:01.911806    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c71a4c33-d129-4615-a8c5-0709d049aaeb-config-file\") pod \"c71a4c33-d129-4615-a8c5-0709d049aaeb\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") "
Jul 27 20:59:01.912043 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:01.911928    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzxsl\" (UniqueName: \"kubernetes.io/projected/c71a4c33-d129-4615-a8c5-0709d049aaeb-kube-api-access-rzxsl\") pod \"c71a4c33-d129-4615-a8c5-0709d049aaeb\" (UID: \"c71a4c33-d129-4615-a8c5-0709d049aaeb\") "
Jul 27 20:59:01.912181 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:01.912157    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c71a4c33-d129-4615-a8c5-0709d049aaeb-config-file" (OuterVolumeSpecName: "config-file") pod "c71a4c33-d129-4615-a8c5-0709d049aaeb" (UID: "c71a4c33-d129-4615-a8c5-0709d049aaeb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:59:01.914107 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:01.914079    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c71a4c33-d129-4615-a8c5-0709d049aaeb-kube-api-access-rzxsl" (OuterVolumeSpecName: "kube-api-access-rzxsl") pod "c71a4c33-d129-4615-a8c5-0709d049aaeb" (UID: "c71a4c33-d129-4615-a8c5-0709d049aaeb"). InnerVolumeSpecName "kube-api-access-rzxsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:02.012604 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.012528    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c71a4c33-d129-4615-a8c5-0709d049aaeb-config-file\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:59:02.012604 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.012598    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzxsl\" (UniqueName: \"kubernetes.io/projected/c71a4c33-d129-4615-a8c5-0709d049aaeb-kube-api-access-rzxsl\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:59:02.652769 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.652676    2566 generic.go:356] "Generic (PLEG): container finished" podID="c71a4c33-d129-4615-a8c5-0709d049aaeb" containerID="f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e" exitCode=0
Jul 27 20:59:02.652769 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.652724    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"
Jul 27 20:59:02.652960 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.652766    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2" event={"ID":"c71a4c33-d129-4615-a8c5-0709d049aaeb","Type":"ContainerDied","Data":"f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e"}
Jul 27 20:59:02.652960 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.652819    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-8jgs2" event={"ID":"c71a4c33-d129-4615-a8c5-0709d049aaeb","Type":"ContainerDied","Data":"764cb14f8f5013f7dfc031c08a83699044d3e30165ed58144ea876a1413b2bab"}
Jul 27 20:59:02.652960 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.652842    2566 scope.go:117] "RemoveContainer" containerID="f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e"
Jul 27 20:59:02.662038 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.662016    2566 scope.go:117] "RemoveContainer" containerID="f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e"
Jul 27 20:59:02.662355 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:59:02.662331    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e\": container with ID starting with f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e not found: ID does not exist" containerID="f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e"
Jul 27 20:59:02.662421 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.662370    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e"} err="failed to get container status \"f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e\": rpc error: code = NotFound desc = could not find container \"f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e\": container with ID starting with f9786dd844406e488af3a927d7c82c75addb5c31ec73fbcc7e89af6e01d29d1e not found: ID does not exist"
Jul 27 20:59:02.673796 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.673761    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"]
Jul 27 20:59:02.678020 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:02.677986    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-8jgs2"]
Jul 27 20:59:04.243716 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:04.243683    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c71a4c33-d129-4615-a8c5-0709d049aaeb" path="/var/lib/kubelet/pods/c71a4c33-d129-4615-a8c5-0709d049aaeb/volumes"
Jul 27 20:59:07.661656 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.661620    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-655hs"]
Jul 27 20:59:07.662039 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.662002    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71a4c33-d129-4615-a8c5-0709d049aaeb" containerName="limitador"
Jul 27 20:59:07.662039 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.662014    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71a4c33-d129-4615-a8c5-0709d049aaeb" containerName="limitador"
Jul 27 20:59:07.662109 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.662074    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c71a4c33-d129-4615-a8c5-0709d049aaeb" containerName="limitador"
Jul 27 20:59:07.665239 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.665216    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:07.668075 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.668048    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mq7mr\""
Jul 27 20:59:07.668223 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.668049    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 20:59:07.668223 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.668118    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 20:59:07.669135 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.669115    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 20:59:07.674707 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.674680    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-655hs"]
Jul 27 20:59:07.761451 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.761418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwsfl\" (UniqueName: \"kubernetes.io/projected/940360ec-1990-4f30-92e3-38bfb426e6e7-kube-api-access-wwsfl\") pod \"postgres-69fb4594cf-655hs\" (UID: \"940360ec-1990-4f30-92e3-38bfb426e6e7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:07.761658 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.761480    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/940360ec-1990-4f30-92e3-38bfb426e6e7-data\") pod \"postgres-69fb4594cf-655hs\" (UID: \"940360ec-1990-4f30-92e3-38bfb426e6e7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:07.862064 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.862012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwsfl\" (UniqueName: \"kubernetes.io/projected/940360ec-1990-4f30-92e3-38bfb426e6e7-kube-api-access-wwsfl\") pod \"postgres-69fb4594cf-655hs\" (UID: \"940360ec-1990-4f30-92e3-38bfb426e6e7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:07.862250 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.862118    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/940360ec-1990-4f30-92e3-38bfb426e6e7-data\") pod \"postgres-69fb4594cf-655hs\" (UID: \"940360ec-1990-4f30-92e3-38bfb426e6e7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:07.862586 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.862569    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/940360ec-1990-4f30-92e3-38bfb426e6e7-data\") pod \"postgres-69fb4594cf-655hs\" (UID: \"940360ec-1990-4f30-92e3-38bfb426e6e7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:07.871286 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.871255    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwsfl\" (UniqueName: \"kubernetes.io/projected/940360ec-1990-4f30-92e3-38bfb426e6e7-kube-api-access-wwsfl\") pod \"postgres-69fb4594cf-655hs\" (UID: \"940360ec-1990-4f30-92e3-38bfb426e6e7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:07.978046 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:07.977957    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:08.143229 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:08.143197    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-655hs"]
Jul 27 20:59:08.144919 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:59:08.144888    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940360ec_1990_4f30_92e3_38bfb426e6e7.slice/crio-1a5c4b33fd84a44f2516801d6c8c07989a76101134bdfd2194d38df12853a22f WatchSource:0}: Error finding container 1a5c4b33fd84a44f2516801d6c8c07989a76101134bdfd2194d38df12853a22f: Status 404 returned error can't find the container with id 1a5c4b33fd84a44f2516801d6c8c07989a76101134bdfd2194d38df12853a22f
Jul 27 20:59:08.693173 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:08.693129    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs" event={"ID":"940360ec-1990-4f30-92e3-38bfb426e6e7","Type":"ContainerStarted","Data":"1a5c4b33fd84a44f2516801d6c8c07989a76101134bdfd2194d38df12853a22f"}
Jul 27 20:59:13.724908 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:13.724874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs" event={"ID":"940360ec-1990-4f30-92e3-38bfb426e6e7","Type":"ContainerStarted","Data":"0b67cd2c09cf02f230709dbca7759c3a8c00fc8266a30312b0c96a0d79ff61e5"}
Jul 27 20:59:13.725380 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:13.724954    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:19.760852 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:19.760816    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs"
Jul 27 20:59:19.808113 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:19.808051    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-655hs" podStartSLOduration=7.9452545610000005 podStartE2EDuration="12.808032955s" totalImagesPullingTime="4.862778394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:59:13.740199103 +0000 UTC m=+480.036530421" watchObservedRunningTime="2026-07-27 20:59:19.808032955 +0000 UTC m=+486.104364273"
Jul 27 20:59:27.088933 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.088892    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74d9c49fbf-hrx8d"]
Jul 27 20:59:27.097197 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.097168    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.100055 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.100023    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 20:59:27.100055 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.100029    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kdkqw\""
Jul 27 20:59:27.100265 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.100081    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 20:59:27.109962 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.109928    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74d9c49fbf-hrx8d"]
Jul 27 20:59:27.152920 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.152880    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert\") pod \"maas-controller-74d9c49fbf-hrx8d\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") " pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.153110 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.152954    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9826\" (UniqueName: \"kubernetes.io/projected/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-kube-api-access-r9826\") pod \"maas-controller-74d9c49fbf-hrx8d\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") " pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.253648 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.253606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9826\" (UniqueName: \"kubernetes.io/projected/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-kube-api-access-r9826\") pod \"maas-controller-74d9c49fbf-hrx8d\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") " pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.253813 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.253710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert\") pod \"maas-controller-74d9c49fbf-hrx8d\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") " pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.253869 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:59:27.253849    2566 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 27 20:59:27.253935 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:59:27.253924    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert podName:7669b5dc-f308-48a8-b6a8-4e71b3a093d7 nodeName:}" failed. No retries permitted until 2026-07-27 20:59:27.7539072 +0000 UTC m=+494.050238499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert") pod "maas-controller-74d9c49fbf-hrx8d" (UID: "7669b5dc-f308-48a8-b6a8-4e71b3a093d7") : secret "maas-controller-webhook-cert" not found
Jul 27 20:59:27.258297 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.258258    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55784848bf-ft2hv"]
Jul 27 20:59:27.261715 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.261694    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:27.266525 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.266496    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9826\" (UniqueName: \"kubernetes.io/projected/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-kube-api-access-r9826\") pod \"maas-controller-74d9c49fbf-hrx8d\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") " pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.271777 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.271753    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55784848bf-ft2hv"]
Jul 27 20:59:27.355031 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.354932    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qds57\" (UniqueName: \"kubernetes.io/projected/48e936e6-ede6-4355-a356-09a99d10e33c-kube-api-access-qds57\") pod \"maas-controller-55784848bf-ft2hv\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") " pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:27.355195 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.355074    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert\") pod \"maas-controller-55784848bf-ft2hv\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") " pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:27.456117 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.456072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert\") pod \"maas-controller-55784848bf-ft2hv\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") " pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:27.456318 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.456179    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qds57\" (UniqueName: \"kubernetes.io/projected/48e936e6-ede6-4355-a356-09a99d10e33c-kube-api-access-qds57\") pod \"maas-controller-55784848bf-ft2hv\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") " pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:27.456318 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:59:27.456241    2566 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 27 20:59:27.456415 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:59:27.456335    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert podName:48e936e6-ede6-4355-a356-09a99d10e33c nodeName:}" failed. No retries permitted until 2026-07-27 20:59:27.956314813 +0000 UTC m=+494.252646110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert") pod "maas-controller-55784848bf-ft2hv" (UID: "48e936e6-ede6-4355-a356-09a99d10e33c") : secret "maas-controller-webhook-cert" not found
Jul 27 20:59:27.471208 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.471177    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qds57\" (UniqueName: \"kubernetes.io/projected/48e936e6-ede6-4355-a356-09a99d10e33c-kube-api-access-qds57\") pod \"maas-controller-55784848bf-ft2hv\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") " pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:27.758213 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.758177    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert\") pod \"maas-controller-74d9c49fbf-hrx8d\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") " pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.760862 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.760834    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert\") pod \"maas-controller-74d9c49fbf-hrx8d\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") " pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:27.960997 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.960949    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert\") pod \"maas-controller-55784848bf-ft2hv\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") " pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:27.963714 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:27.963682    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert\") pod \"maas-controller-55784848bf-ft2hv\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") " pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:28.008617 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:28.008501    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:28.153914 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:28.153886    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74d9c49fbf-hrx8d"]
Jul 27 20:59:28.155996 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:59:28.155963    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7669b5dc_f308_48a8_b6a8_4e71b3a093d7.slice/crio-c67f341cab752e8acc1e80c5b2b1d5f74c49b477a28988c1c41cc15a2d436c18 WatchSource:0}: Error finding container c67f341cab752e8acc1e80c5b2b1d5f74c49b477a28988c1c41cc15a2d436c18: Status 404 returned error can't find the container with id c67f341cab752e8acc1e80c5b2b1d5f74c49b477a28988c1c41cc15a2d436c18
Jul 27 20:59:28.184620 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:28.184578    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:28.332516 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:28.332483    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55784848bf-ft2hv"]
Jul 27 20:59:28.334564 ip-10-0-141-50 kubenswrapper[2566]: W0727 20:59:28.334519    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e936e6_ede6_4355_a356_09a99d10e33c.slice/crio-5c5257f080759feb07d2c53733587ea07bc6b562c25e8a181a3a093b8aa8f94d WatchSource:0}: Error finding container 5c5257f080759feb07d2c53733587ea07bc6b562c25e8a181a3a093b8aa8f94d: Status 404 returned error can't find the container with id 5c5257f080759feb07d2c53733587ea07bc6b562c25e8a181a3a093b8aa8f94d
Jul 27 20:59:28.808945 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:28.808908    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55784848bf-ft2hv" event={"ID":"48e936e6-ede6-4355-a356-09a99d10e33c","Type":"ContainerStarted","Data":"5c5257f080759feb07d2c53733587ea07bc6b562c25e8a181a3a093b8aa8f94d"}
Jul 27 20:59:28.810437 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:28.810385    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d" event={"ID":"7669b5dc-f308-48a8-b6a8-4e71b3a093d7","Type":"ContainerStarted","Data":"c67f341cab752e8acc1e80c5b2b1d5f74c49b477a28988c1c41cc15a2d436c18"}
Jul 27 20:59:31.829683 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:31.829641    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55784848bf-ft2hv" event={"ID":"48e936e6-ede6-4355-a356-09a99d10e33c","Type":"ContainerStarted","Data":"8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc"}
Jul 27 20:59:31.830243 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:31.829771    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:31.831401 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:31.831375    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d" event={"ID":"7669b5dc-f308-48a8-b6a8-4e71b3a093d7","Type":"ContainerStarted","Data":"3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2"}
Jul 27 20:59:31.831523 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:31.831460    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:31.851255 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:31.851203    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55784848bf-ft2hv" podStartSLOduration=2.395673472 podStartE2EDuration="4.851184025s" totalImagesPullingTime="2.455510553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:59:31.850222778 +0000 UTC m=+498.146554121" watchObservedRunningTime="2026-07-27 20:59:31.851184025 +0000 UTC m=+498.147515343"
Jul 27 20:59:31.918157 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:31.918099    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d" podStartSLOduration=2.290913284 podStartE2EDuration="4.918080995s" totalImagesPullingTime="2.627167711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:59:31.916663135 +0000 UTC m=+498.212994457" watchObservedRunningTime="2026-07-27 20:59:31.918080995 +0000 UTC m=+498.214412314"
Jul 27 20:59:42.845642 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:42.845611    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:42.846131 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:42.845681    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 20:59:42.915357 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:42.915319    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74d9c49fbf-hrx8d"]
Jul 27 20:59:42.915576 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:42.915551    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d" podUID="7669b5dc-f308-48a8-b6a8-4e71b3a093d7" containerName="manager" containerID="cri-o://3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2" gracePeriod=30
Jul 27 20:59:43.174210 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.174178    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:43.311563 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.311494    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9826\" (UniqueName: \"kubernetes.io/projected/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-kube-api-access-r9826\") pod \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") "
Jul 27 20:59:43.311737 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.311587    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert\") pod \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\" (UID: \"7669b5dc-f308-48a8-b6a8-4e71b3a093d7\") "
Jul 27 20:59:43.314076 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.314035    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-kube-api-access-r9826" (OuterVolumeSpecName: "kube-api-access-r9826") pod "7669b5dc-f308-48a8-b6a8-4e71b3a093d7" (UID: "7669b5dc-f308-48a8-b6a8-4e71b3a093d7"). InnerVolumeSpecName "kube-api-access-r9826". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:59:43.314076 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.314050    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7669b5dc-f308-48a8-b6a8-4e71b3a093d7" (UID: "7669b5dc-f308-48a8-b6a8-4e71b3a093d7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:59:43.412560 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.412469    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9826\" (UniqueName: \"kubernetes.io/projected/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-kube-api-access-r9826\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:59:43.412560 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.412495    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7669b5dc-f308-48a8-b6a8-4e71b3a093d7-webhook-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 20:59:43.900680 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.900640    2566 generic.go:356] "Generic (PLEG): container finished" podID="7669b5dc-f308-48a8-b6a8-4e71b3a093d7" containerID="3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2" exitCode=0
Jul 27 20:59:43.900680 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.900681    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d"
Jul 27 20:59:43.901178 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.900724    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d" event={"ID":"7669b5dc-f308-48a8-b6a8-4e71b3a093d7","Type":"ContainerDied","Data":"3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2"}
Jul 27 20:59:43.901178 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.900773    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d9c49fbf-hrx8d" event={"ID":"7669b5dc-f308-48a8-b6a8-4e71b3a093d7","Type":"ContainerDied","Data":"c67f341cab752e8acc1e80c5b2b1d5f74c49b477a28988c1c41cc15a2d436c18"}
Jul 27 20:59:43.901178 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.900794    2566 scope.go:117] "RemoveContainer" containerID="3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2"
Jul 27 20:59:43.910459 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.910439    2566 scope.go:117] "RemoveContainer" containerID="3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2"
Jul 27 20:59:43.910797 ip-10-0-141-50 kubenswrapper[2566]: E0727 20:59:43.910778    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2\": container with ID starting with 3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2 not found: ID does not exist" containerID="3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2"
Jul 27 20:59:43.910857 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.910807    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2"} err="failed to get container status \"3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2\": rpc error: code = NotFound desc = could not find container \"3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2\": container with ID starting with 3e1c170a5097647013666af6834c6c820237fdff2cf49e1334402d413e7a15e2 not found: ID does not exist"
Jul 27 20:59:43.925567 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.925511    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74d9c49fbf-hrx8d"]
Jul 27 20:59:43.935836 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:43.935801    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74d9c49fbf-hrx8d"]
Jul 27 20:59:44.245172 ip-10-0-141-50 kubenswrapper[2566]: I0727 20:59:44.245130    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7669b5dc-f308-48a8-b6a8-4e71b3a093d7" path="/var/lib/kubelet/pods/7669b5dc-f308-48a8-b6a8-4e71b3a093d7/volumes"
Jul 27 21:00:04.319832 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.319795    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"]
Jul 27 21:00:04.320292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.320158    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7669b5dc-f308-48a8-b6a8-4e71b3a093d7" containerName="manager"
Jul 27 21:00:04.320292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.320169    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7669b5dc-f308-48a8-b6a8-4e71b3a093d7" containerName="manager"
Jul 27 21:00:04.320292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.320241    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7669b5dc-f308-48a8-b6a8-4e71b3a093d7" containerName="manager"
Jul 27 21:00:04.462615 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.462579    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"]
Jul 27 21:00:04.462781 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.462697    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.465663 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.465640    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 21:00:04.503576 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.503490    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xp7w\" (UniqueName: \"kubernetes.io/projected/18a809de-25de-4e54-bced-7c8c2d637d2b-kube-api-access-8xp7w\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.503765 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.503617    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a809de-25de-4e54-bced-7c8c2d637d2b-maas-api-tls\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.503765 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.503653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a809de-25de-4e54-bced-7c8c2d637d2b-openshift-service-ca\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.604977 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.604885    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xp7w\" (UniqueName: \"kubernetes.io/projected/18a809de-25de-4e54-bced-7c8c2d637d2b-kube-api-access-8xp7w\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.604977 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.604963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a809de-25de-4e54-bced-7c8c2d637d2b-maas-api-tls\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.605168 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.605001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a809de-25de-4e54-bced-7c8c2d637d2b-openshift-service-ca\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.605735 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.605664    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18a809de-25de-4e54-bced-7c8c2d637d2b-openshift-service-ca\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.607715 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.607685    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18a809de-25de-4e54-bced-7c8c2d637d2b-maas-api-tls\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.625395 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.625359    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xp7w\" (UniqueName: \"kubernetes.io/projected/18a809de-25de-4e54-bced-7c8c2d637d2b-kube-api-access-8xp7w\") pod \"maas-api-65694fbd5f-p9tmn\" (UID: \"18a809de-25de-4e54-bced-7c8c2d637d2b\") " pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.773972 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.773937    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:04.937332 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:04.937291    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"]
Jul 27 21:00:04.938928 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:00:04.938896    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a809de_25de_4e54_bced_7c8c2d637d2b.slice/crio-10fcfe123832bf3cbc2b65ba13b3061bd042aaa316e79a03aa5079e55f878506 WatchSource:0}: Error finding container 10fcfe123832bf3cbc2b65ba13b3061bd042aaa316e79a03aa5079e55f878506: Status 404 returned error can't find the container with id 10fcfe123832bf3cbc2b65ba13b3061bd042aaa316e79a03aa5079e55f878506
Jul 27 21:00:05.009589 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.009494    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn" event={"ID":"18a809de-25de-4e54-bced-7c8c2d637d2b","Type":"ContainerStarted","Data":"10fcfe123832bf3cbc2b65ba13b3061bd042aaa316e79a03aa5079e55f878506"}
Jul 27 21:00:05.029203 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.029169    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8zrzr"]
Jul 27 21:00:05.032481 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.032465    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.036247 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.036227    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 21:00:05.061986 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.061953    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8zrzr"]
Jul 27 21:00:05.077276 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.077229    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"]
Jul 27 21:00:05.079663 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.079636    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.083838 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.083813    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mmv54\""
Jul 27 21:00:05.096511 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.096460    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"]
Jul 27 21:00:05.109890 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.109850    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh26z\" (UniqueName: \"kubernetes.io/projected/514ca926-21a1-46cc-8e13-c0281ecd5d1a-kube-api-access-wh26z\") pod \"payload-pre-processing-687dbb6cf6-dnpxs\" (UID: \"514ca926-21a1-46cc-8e13-c0281ecd5d1a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.110072 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.109969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trnq9\" (UniqueName: \"kubernetes.io/projected/e2c6ae0c-916b-4a64-9085-2c9604df477a-kube-api-access-trnq9\") pod \"payload-processing-5cc6cd444b-8zrzr\" (UID: \"e2c6ae0c-916b-4a64-9085-2c9604df477a\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.110072 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.110023    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2c6ae0c-916b-4a64-9085-2c9604df477a-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8zrzr\" (UID: \"e2c6ae0c-916b-4a64-9085-2c9604df477a\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.110184 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.110074    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514ca926-21a1-46cc-8e13-c0281ecd5d1a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-dnpxs\" (UID: \"514ca926-21a1-46cc-8e13-c0281ecd5d1a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.211020 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.210912    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh26z\" (UniqueName: \"kubernetes.io/projected/514ca926-21a1-46cc-8e13-c0281ecd5d1a-kube-api-access-wh26z\") pod \"payload-pre-processing-687dbb6cf6-dnpxs\" (UID: \"514ca926-21a1-46cc-8e13-c0281ecd5d1a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.211020 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.210974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trnq9\" (UniqueName: \"kubernetes.io/projected/e2c6ae0c-916b-4a64-9085-2c9604df477a-kube-api-access-trnq9\") pod \"payload-processing-5cc6cd444b-8zrzr\" (UID: \"e2c6ae0c-916b-4a64-9085-2c9604df477a\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.211395 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.211024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2c6ae0c-916b-4a64-9085-2c9604df477a-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8zrzr\" (UID: \"e2c6ae0c-916b-4a64-9085-2c9604df477a\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.211395 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.211071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514ca926-21a1-46cc-8e13-c0281ecd5d1a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-dnpxs\" (UID: \"514ca926-21a1-46cc-8e13-c0281ecd5d1a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.212142 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.212002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514ca926-21a1-46cc-8e13-c0281ecd5d1a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-dnpxs\" (UID: \"514ca926-21a1-46cc-8e13-c0281ecd5d1a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.212142 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.212002    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2c6ae0c-916b-4a64-9085-2c9604df477a-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8zrzr\" (UID: \"e2c6ae0c-916b-4a64-9085-2c9604df477a\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.220092 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.220067    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh26z\" (UniqueName: \"kubernetes.io/projected/514ca926-21a1-46cc-8e13-c0281ecd5d1a-kube-api-access-wh26z\") pod \"payload-pre-processing-687dbb6cf6-dnpxs\" (UID: \"514ca926-21a1-46cc-8e13-c0281ecd5d1a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.220218 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.220109    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trnq9\" (UniqueName: \"kubernetes.io/projected/e2c6ae0c-916b-4a64-9085-2c9604df477a-kube-api-access-trnq9\") pod \"payload-processing-5cc6cd444b-8zrzr\" (UID: \"e2c6ae0c-916b-4a64-9085-2c9604df477a\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.343946 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.343909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:05.391064 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.391025    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:05.508439 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.506205    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8zrzr"]
Jul 27 21:00:05.566888 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:05.566853    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"]
Jul 27 21:00:05.568673 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:00:05.568640    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514ca926_21a1_46cc_8e13_c0281ecd5d1a.slice/crio-ba6a28c1e50a07e1c262e1e7a7072ee1e38453ec42306070fafc8384f709be8f WatchSource:0}: Error finding container ba6a28c1e50a07e1c262e1e7a7072ee1e38453ec42306070fafc8384f709be8f: Status 404 returned error can't find the container with id ba6a28c1e50a07e1c262e1e7a7072ee1e38453ec42306070fafc8384f709be8f
Jul 27 21:00:06.016817 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:06.016777    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs" event={"ID":"514ca926-21a1-46cc-8e13-c0281ecd5d1a","Type":"ContainerStarted","Data":"ba6a28c1e50a07e1c262e1e7a7072ee1e38453ec42306070fafc8384f709be8f"}
Jul 27 21:00:06.018101 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:06.018075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr" event={"ID":"e2c6ae0c-916b-4a64-9085-2c9604df477a","Type":"ContainerStarted","Data":"6052e2afd5abbb5612557e4c5b1097194c9b8ce11caa3705c91c2ea2d155ff88"}
Jul 27 21:00:08.036042 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.035979    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr" event={"ID":"e2c6ae0c-916b-4a64-9085-2c9604df477a","Type":"ContainerStarted","Data":"a6a7c391a8db7f8483cf7cf64caa9701e2a3d404f6cc8e681f7bbbd538a58fc7"}
Jul 27 21:00:08.036568 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.036062    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:08.037736 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.037705    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn" event={"ID":"18a809de-25de-4e54-bced-7c8c2d637d2b","Type":"ContainerStarted","Data":"10e0a1728b8538c599a1dfab97058a837a4aa8fd2958eb4e9f6efb6f1e560bea"}
Jul 27 21:00:08.037875 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.037812    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:08.039496 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.039467    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs" event={"ID":"514ca926-21a1-46cc-8e13-c0281ecd5d1a","Type":"ContainerStarted","Data":"749144a894854cf3f376ba92d7524119e85e80aba502601c47ac2e7c45dfb093"}
Jul 27 21:00:08.039640 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.039590    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:08.053085 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.053024    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr" podStartSLOduration=1.028522555 podStartE2EDuration="3.05300332s" totalImagesPullingTime="2.024480765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:08.052266127 +0000 UTC m=+534.348597446" watchObservedRunningTime="2026-07-27 21:00:08.05300332 +0000 UTC m=+534.349334617"
Jul 27 21:00:08.075475 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:08.075421    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs" podStartSLOduration=1.108273033 podStartE2EDuration="3.075402951s" totalImagesPullingTime="1.967129918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:08.072775722 +0000 UTC m=+534.369107039" watchObservedRunningTime="2026-07-27 21:00:08.075402951 +0000 UTC m=+534.371734269"
Jul 27 21:00:14.049945 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:14.049911    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn"
Jul 27 21:00:14.070373 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:14.070318    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65694fbd5f-p9tmn" podStartSLOduration=7.891502212 podStartE2EDuration="10.070301768s" totalImagesPullingTime="2.178799556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:08.113677189 +0000 UTC m=+534.410008506" watchObservedRunningTime="2026-07-27 21:00:14.070301768 +0000 UTC m=+540.366633096"
Jul 27 21:00:19.046343 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:19.046309    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-dnpxs"
Jul 27 21:00:19.046753 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:19.046390    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8zrzr"
Jul 27 21:00:23.933945 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:23.933914    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"]
Jul 27 21:00:23.943840 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:23.943806    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:23.947217 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:23.947192    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 21:00:23.948306 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:23.948285    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 27 21:00:23.948426 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:23.948291    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 21:00:23.948426 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:23.948390    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qcv5g\""
Jul 27 21:00:23.948903 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:23.948882    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"]
Jul 27 21:00:24.091791 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.091754    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b170d1-d54b-4b66-abc4-749fb5e7f057-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.092016 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.091805    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.092016 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.091845    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.092016 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.091885    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tvk\" (UniqueName: \"kubernetes.io/projected/49b170d1-d54b-4b66-abc4-749fb5e7f057-kube-api-access-s4tvk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.092016 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.091950    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.092016 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.092002    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.193275 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193172    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.193275 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193233    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.193514 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b170d1-d54b-4b66-abc4-749fb5e7f057-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.193514 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193316    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.193741 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193349    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.196133 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193767    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.196133 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193786    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tvk\" (UniqueName: \"kubernetes.io/projected/49b170d1-d54b-4b66-abc4-749fb5e7f057-kube-api-access-s4tvk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.196133 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.193931    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.196133 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.194028    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.196365 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.196350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49b170d1-d54b-4b66-abc4-749fb5e7f057-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.196690 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.196660    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49b170d1-d54b-4b66-abc4-749fb5e7f057-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.202976 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.202950    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tvk\" (UniqueName: \"kubernetes.io/projected/49b170d1-d54b-4b66-abc4-749fb5e7f057-kube-api-access-s4tvk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf\" (UID: \"49b170d1-d54b-4b66-abc4-749fb5e7f057\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.256619 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.256582    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:24.405137 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:24.405104    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"]
Jul 27 21:00:24.406418 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:00:24.406377    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b170d1_d54b_4b66_abc4_749fb5e7f057.slice/crio-db56f42032fbbb76a69bf8d03c071db01e947697b8babd3ebe53d38d60ce1e0c WatchSource:0}: Error finding container db56f42032fbbb76a69bf8d03c071db01e947697b8babd3ebe53d38d60ce1e0c: Status 404 returned error can't find the container with id db56f42032fbbb76a69bf8d03c071db01e947697b8babd3ebe53d38d60ce1e0c
Jul 27 21:00:25.132115 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:25.132079    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf" event={"ID":"49b170d1-d54b-4b66-abc4-749fb5e7f057","Type":"ContainerStarted","Data":"db56f42032fbbb76a69bf8d03c071db01e947697b8babd3ebe53d38d60ce1e0c"}
Jul 27 21:00:37.214944 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:37.214877    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf" podStartSLOduration=1.489018337 podStartE2EDuration="14.214858144s" totalImagesPullingTime="12.725839807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:37.214339071 +0000 UTC m=+563.510670390" watchObservedRunningTime="2026-07-27 21:00:37.214858144 +0000 UTC m=+563.511189462"
Jul 27 21:00:38.204291 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:38.204252    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf" event={"ID":"49b170d1-d54b-4b66-abc4-749fb5e7f057","Type":"ContainerStarted","Data":"5c28c4fc45891d146b1084eddba853e259fb5ffd974efee0939391825accf5ad"}
Jul 27 21:00:44.257426 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:44.257386    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:44.257881 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:44.257490    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:44.270212 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:44.270182    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:45.254795 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:45.254764    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf"
Jul 27 21:00:49.909593 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.909518    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"]
Jul 27 21:00:49.916077 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.916051    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:49.919521 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.919499    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 21:00:49.931548 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.931499    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"]
Jul 27 21:00:49.942581 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.942519    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a904085-e184-4ec1-a523-0b8af28205bc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:49.942581 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.942581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:49.942800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.942614    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:49.942800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.942640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btgjj\" (UniqueName: \"kubernetes.io/projected/8a904085-e184-4ec1-a523-0b8af28205bc-kube-api-access-btgjj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:49.942800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.942732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:49.942800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:49.942767    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043237 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043196    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043237 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgjj\" (UniqueName: \"kubernetes.io/projected/8a904085-e184-4ec1-a523-0b8af28205bc-kube-api-access-btgjj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043506 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043506 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043309    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043506 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a904085-e184-4ec1-a523-0b8af28205bc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043726 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043520    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043726 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043686    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043828 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043725    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.043828 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.043777    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.045984 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.045949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a904085-e184-4ec1-a523-0b8af28205bc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.046246 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.046227    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a904085-e184-4ec1-a523-0b8af28205bc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.052800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.052774    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btgjj\" (UniqueName: \"kubernetes.io/projected/8a904085-e184-4ec1-a523-0b8af28205bc-kube-api-access-btgjj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t5mj2\" (UID: \"8a904085-e184-4ec1-a523-0b8af28205bc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.227587 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.227446    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:00:50.384244 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:50.384210    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"]
Jul 27 21:00:50.386225 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:00:50.386199    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a904085_e184_4ec1_a523_0b8af28205bc.slice/crio-854b496b2f8b52377876887d922bd9235d4ddac9e9bba82d898c0b049c7db441 WatchSource:0}: Error finding container 854b496b2f8b52377876887d922bd9235d4ddac9e9bba82d898c0b049c7db441: Status 404 returned error can't find the container with id 854b496b2f8b52377876887d922bd9235d4ddac9e9bba82d898c0b049c7db441
Jul 27 21:00:51.278239 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:51.278202    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2" event={"ID":"8a904085-e184-4ec1-a523-0b8af28205bc","Type":"ContainerStarted","Data":"854b496b2f8b52377876887d922bd9235d4ddac9e9bba82d898c0b049c7db441"}
Jul 27 21:00:53.290609 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:53.290565    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2" event={"ID":"8a904085-e184-4ec1-a523-0b8af28205bc","Type":"ContainerStarted","Data":"cf5110cdba53d3ba4dedeb7b85f1a7b1456208f5834e56352c141cc6170cccc1"}
Jul 27 21:00:53.309570 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:00:53.309492    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2" podStartSLOduration=1.574229303 podStartE2EDuration="4.309472927s" totalImagesPullingTime="2.735243624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:00:53.307442452 +0000 UTC m=+579.603773771" watchObservedRunningTime="2026-07-27 21:00:53.309472927 +0000 UTC m=+579.605804244"
Jul 27 21:01:00.228427 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:00.228382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:01:00.228952 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:00.228447    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:01:00.250888 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:00.250857    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:01:00.338479 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:00.338446    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t5mj2"
Jul 27 21:01:14.138097 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:14.138055    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:01:14.141215 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:14.141183    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:01:18.020461 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.020425    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"]
Jul 27 21:01:18.023306 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.023283    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.026300 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.026259    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 27 21:01:18.036214 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.036186    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"]
Jul 27 21:01:18.114344 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.114293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.114599 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.114354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.114599 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.114383    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8kcq\" (UniqueName: \"kubernetes.io/projected/bde86cee-cefb-4f86-ab63-029f6720c1a1-kube-api-access-n8kcq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.114599 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.114435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde86cee-cefb-4f86-ab63-029f6720c1a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.114599 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.114461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.114599 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.114496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.215571 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.215510    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde86cee-cefb-4f86-ab63-029f6720c1a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.215571 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.215575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.215829 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.215599    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.215829 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.215696    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.215829 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.215726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.215829 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.215757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8kcq\" (UniqueName: \"kubernetes.io/projected/bde86cee-cefb-4f86-ab63-029f6720c1a1-kube-api-access-n8kcq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.216041 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.216022    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.216104 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.216068    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.216212 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.216188    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.218737 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.218705    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde86cee-cefb-4f86-ab63-029f6720c1a1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.218993 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.218974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde86cee-cefb-4f86-ab63-029f6720c1a1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.225028 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.224998    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8kcq\" (UniqueName: \"kubernetes.io/projected/bde86cee-cefb-4f86-ab63-029f6720c1a1-kube-api-access-n8kcq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdg2l\" (UID: \"bde86cee-cefb-4f86-ab63-029f6720c1a1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.336306 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.336198    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:18.484584 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:18.484555    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"]
Jul 27 21:01:18.486201 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:01:18.486172    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde86cee_cefb_4f86_ab63_029f6720c1a1.slice/crio-cc8055429d8f6ce0b9aae5f05ec3c0b21cef8ad9f2b6a2d87406aa20fe129475 WatchSource:0}: Error finding container cc8055429d8f6ce0b9aae5f05ec3c0b21cef8ad9f2b6a2d87406aa20fe129475: Status 404 returned error can't find the container with id cc8055429d8f6ce0b9aae5f05ec3c0b21cef8ad9f2b6a2d87406aa20fe129475
Jul 27 21:01:19.434997 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:19.434901    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l" event={"ID":"bde86cee-cefb-4f86-ab63-029f6720c1a1","Type":"ContainerStarted","Data":"26dc870ae2ef7244537e79433f876b6d252f39987b2a70074412060e0ded8cdd"}
Jul 27 21:01:19.434997 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:19.434974    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l" event={"ID":"bde86cee-cefb-4f86-ab63-029f6720c1a1","Type":"ContainerStarted","Data":"cc8055429d8f6ce0b9aae5f05ec3c0b21cef8ad9f2b6a2d87406aa20fe129475"}
Jul 27 21:01:19.452887 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:19.452832    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l" podStartSLOduration=0.894027223 podStartE2EDuration="1.452813372s" totalImagesPullingTime="558.786149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:19.450740721 +0000 UTC m=+605.747072040" watchObservedRunningTime="2026-07-27 21:01:19.452813372 +0000 UTC m=+605.749144681"
Jul 27 21:01:28.336941 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:28.336906    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:28.337435 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:28.336969    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:28.349875 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:28.349841    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:01:28.493803 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:01:28.493772    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdg2l"
Jul 27 21:03:17.555672 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.555630    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55784848bf-ft2hv"]
Jul 27 21:03:17.556106 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.555861    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55784848bf-ft2hv" podUID="48e936e6-ede6-4355-a356-09a99d10e33c" containerName="manager" containerID="cri-o://8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc" gracePeriod=30
Jul 27 21:03:17.815868 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.815788    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 21:03:17.881382 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.881351    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert\") pod \"48e936e6-ede6-4355-a356-09a99d10e33c\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") "
Jul 27 21:03:17.881575 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.881469    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qds57\" (UniqueName: \"kubernetes.io/projected/48e936e6-ede6-4355-a356-09a99d10e33c-kube-api-access-qds57\") pod \"48e936e6-ede6-4355-a356-09a99d10e33c\" (UID: \"48e936e6-ede6-4355-a356-09a99d10e33c\") "
Jul 27 21:03:17.883675 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.883635    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e936e6-ede6-4355-a356-09a99d10e33c-kube-api-access-qds57" (OuterVolumeSpecName: "kube-api-access-qds57") pod "48e936e6-ede6-4355-a356-09a99d10e33c" (UID: "48e936e6-ede6-4355-a356-09a99d10e33c"). InnerVolumeSpecName "kube-api-access-qds57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:17.883675 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.883669    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "48e936e6-ede6-4355-a356-09a99d10e33c" (UID: "48e936e6-ede6-4355-a356-09a99d10e33c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:17.982749 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.982700    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48e936e6-ede6-4355-a356-09a99d10e33c-webhook-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:03:17.982749 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:17.982743    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qds57\" (UniqueName: \"kubernetes.io/projected/48e936e6-ede6-4355-a356-09a99d10e33c-kube-api-access-qds57\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:03:18.075054 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.074967    2566 generic.go:356] "Generic (PLEG): container finished" podID="48e936e6-ede6-4355-a356-09a99d10e33c" containerID="8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc" exitCode=0
Jul 27 21:03:18.075054 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.075013    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55784848bf-ft2hv" event={"ID":"48e936e6-ede6-4355-a356-09a99d10e33c","Type":"ContainerDied","Data":"8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc"}
Jul 27 21:03:18.075054 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.075056    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55784848bf-ft2hv" event={"ID":"48e936e6-ede6-4355-a356-09a99d10e33c","Type":"ContainerDied","Data":"5c5257f080759feb07d2c53733587ea07bc6b562c25e8a181a3a093b8aa8f94d"}
Jul 27 21:03:18.075292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.075078    2566 scope.go:117] "RemoveContainer" containerID="8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc"
Jul 27 21:03:18.075292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.075019    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55784848bf-ft2hv"
Jul 27 21:03:18.086912 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.086887    2566 scope.go:117] "RemoveContainer" containerID="8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc"
Jul 27 21:03:18.087384 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:03:18.087358    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc\": container with ID starting with 8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc not found: ID does not exist" containerID="8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc"
Jul 27 21:03:18.087486 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.087391    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc"} err="failed to get container status \"8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc\": rpc error: code = NotFound desc = could not find container \"8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc\": container with ID starting with 8297bb610b9011506533b8dc877369a27d4628eafc3ec2958c91e309f3eb5abc not found: ID does not exist"
Jul 27 21:03:18.098193 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.098165    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55784848bf-ft2hv"]
Jul 27 21:03:18.102704 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.102681    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55784848bf-ft2hv"]
Jul 27 21:03:18.243886 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:03:18.243853    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e936e6-ede6-4355-a356-09a99d10e33c" path="/var/lib/kubelet/pods/48e936e6-ede6-4355-a356-09a99d10e33c/volumes"
Jul 27 21:06:14.174948 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:06:14.174916    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:06:14.174948 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:06:14.174927    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:09:48.794549 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:48.794490    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"]
Jul 27 21:09:48.796870 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:48.794722    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9" podUID="c43fe161-467c-4ffd-9f3a-f95a024deb3c" containerName="manager" containerID="cri-o://cef28b288601655a08721fc9e42fedc35b66bd4f3ef2180f3923dcb1e92200f9" gracePeriod=10
Jul 27 21:09:52.199323 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.199288    2566 generic.go:356] "Generic (PLEG): container finished" podID="c43fe161-467c-4ffd-9f3a-f95a024deb3c" containerID="cef28b288601655a08721fc9e42fedc35b66bd4f3ef2180f3923dcb1e92200f9" exitCode=0
Jul 27 21:09:52.199726 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.199362    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9" event={"ID":"c43fe161-467c-4ffd-9f3a-f95a024deb3c","Type":"ContainerDied","Data":"cef28b288601655a08721fc9e42fedc35b66bd4f3ef2180f3923dcb1e92200f9"}
Jul 27 21:09:52.659171 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.659143    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 21:09:52.756499 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.756459    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c43fe161-467c-4ffd-9f3a-f95a024deb3c-extensions-socket-volume\") pod \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") "
Jul 27 21:09:52.756499 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.756503    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l44fs\" (UniqueName: \"kubernetes.io/projected/c43fe161-467c-4ffd-9f3a-f95a024deb3c-kube-api-access-l44fs\") pod \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\" (UID: \"c43fe161-467c-4ffd-9f3a-f95a024deb3c\") "
Jul 27 21:09:52.756910 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.756886    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c43fe161-467c-4ffd-9f3a-f95a024deb3c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c43fe161-467c-4ffd-9f3a-f95a024deb3c" (UID: "c43fe161-467c-4ffd-9f3a-f95a024deb3c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:52.758906 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.758857    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c43fe161-467c-4ffd-9f3a-f95a024deb3c-kube-api-access-l44fs" (OuterVolumeSpecName: "kube-api-access-l44fs") pod "c43fe161-467c-4ffd-9f3a-f95a024deb3c" (UID: "c43fe161-467c-4ffd-9f3a-f95a024deb3c"). InnerVolumeSpecName "kube-api-access-l44fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:52.858170 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.858128    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c43fe161-467c-4ffd-9f3a-f95a024deb3c-extensions-socket-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:09:52.858170 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:52.858160    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l44fs\" (UniqueName: \"kubernetes.io/projected/c43fe161-467c-4ffd-9f3a-f95a024deb3c-kube-api-access-l44fs\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:09:53.206375 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:53.206283    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9" event={"ID":"c43fe161-467c-4ffd-9f3a-f95a024deb3c","Type":"ContainerDied","Data":"ed7d3d0ca367f369750d26f39eef9d25cafeb297565dd0c7fa21177dc5634265"}
Jul 27 21:09:53.206375 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:53.206309    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"
Jul 27 21:09:53.206375 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:53.206347    2566 scope.go:117] "RemoveContainer" containerID="cef28b288601655a08721fc9e42fedc35b66bd4f3ef2180f3923dcb1e92200f9"
Jul 27 21:09:53.231095 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:53.231049    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"]
Jul 27 21:09:53.237854 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:53.237809    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gv6w9"]
Jul 27 21:09:54.243833 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:09:54.243801    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c43fe161-467c-4ffd-9f3a-f95a024deb3c" path="/var/lib/kubelet/pods/c43fe161-467c-4ffd-9f3a-f95a024deb3c/volumes"
Jul 27 21:10:49.875485 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.875388    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"]
Jul 27 21:10:49.876075 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.876019    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e936e6-ede6-4355-a356-09a99d10e33c" containerName="manager"
Jul 27 21:10:49.876075 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.876039    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e936e6-ede6-4355-a356-09a99d10e33c" containerName="manager"
Jul 27 21:10:49.876075 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.876062    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c43fe161-467c-4ffd-9f3a-f95a024deb3c" containerName="manager"
Jul 27 21:10:49.876075 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.876070    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c43fe161-467c-4ffd-9f3a-f95a024deb3c" containerName="manager"
Jul 27 21:10:49.876293 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.876173    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c43fe161-467c-4ffd-9f3a-f95a024deb3c" containerName="manager"
Jul 27 21:10:49.876293 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.876186    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e936e6-ede6-4355-a356-09a99d10e33c" containerName="manager"
Jul 27 21:10:49.879419 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.879397    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:49.882292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.882269    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 21:10:49.882546 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.882517    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfg2h\""
Jul 27 21:10:49.882817 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.882801    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 21:10:49.890677 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.890656    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"]
Jul 27 21:10:49.995723 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.995688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pk64\" (UniqueName: \"kubernetes.io/projected/124d9c8e-b0ee-4c47-8fce-d9cb6d273830-kube-api-access-6pk64\") pod \"kuadrant-operator-controller-manager-86878c769f-s58wq\" (UID: \"124d9c8e-b0ee-4c47-8fce-d9cb6d273830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:49.995903 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:49.995765    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/124d9c8e-b0ee-4c47-8fce-d9cb6d273830-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s58wq\" (UID: \"124d9c8e-b0ee-4c47-8fce-d9cb6d273830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:50.096870 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.096832    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/124d9c8e-b0ee-4c47-8fce-d9cb6d273830-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s58wq\" (UID: \"124d9c8e-b0ee-4c47-8fce-d9cb6d273830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:50.097045 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.096908    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pk64\" (UniqueName: \"kubernetes.io/projected/124d9c8e-b0ee-4c47-8fce-d9cb6d273830-kube-api-access-6pk64\") pod \"kuadrant-operator-controller-manager-86878c769f-s58wq\" (UID: \"124d9c8e-b0ee-4c47-8fce-d9cb6d273830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:50.097229 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.097209    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/124d9c8e-b0ee-4c47-8fce-d9cb6d273830-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s58wq\" (UID: \"124d9c8e-b0ee-4c47-8fce-d9cb6d273830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:50.106743 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.106702    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pk64\" (UniqueName: \"kubernetes.io/projected/124d9c8e-b0ee-4c47-8fce-d9cb6d273830-kube-api-access-6pk64\") pod \"kuadrant-operator-controller-manager-86878c769f-s58wq\" (UID: \"124d9c8e-b0ee-4c47-8fce-d9cb6d273830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:50.190770 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.190663    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:50.344714 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.344685    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"]
Jul 27 21:10:50.346025 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:10:50.345989    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124d9c8e_b0ee_4c47_8fce_d9cb6d273830.slice/crio-8ede523359703278d760c59be0573c1d85da81ae95d07b8547aaaec71e4323e0 WatchSource:0}: Error finding container 8ede523359703278d760c59be0573c1d85da81ae95d07b8547aaaec71e4323e0: Status 404 returned error can't find the container with id 8ede523359703278d760c59be0573c1d85da81ae95d07b8547aaaec71e4323e0
Jul 27 21:10:50.522724 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.522688    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq" event={"ID":"124d9c8e-b0ee-4c47-8fce-d9cb6d273830","Type":"ContainerStarted","Data":"44f2c518f38c5f79304f2a87fd88465ddacc6105dc2b46e4f48b5ab37c43243f"}
Jul 27 21:10:50.522925 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.522740    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq" event={"ID":"124d9c8e-b0ee-4c47-8fce-d9cb6d273830","Type":"ContainerStarted","Data":"8ede523359703278d760c59be0573c1d85da81ae95d07b8547aaaec71e4323e0"}
Jul 27 21:10:50.522925 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.522782    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:10:50.559680 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:10:50.559624    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq" podStartSLOduration=1.559604263 podStartE2EDuration="1.559604263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:50.557585603 +0000 UTC m=+1176.853916923" watchObservedRunningTime="2026-07-27 21:10:50.559604263 +0000 UTC m=+1176.855935572"
Jul 27 21:11:01.533492 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:11:01.533455    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s58wq"
Jul 27 21:11:14.207920 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:11:14.207889    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:11:14.208434 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:11:14.208271    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:16:14.243481 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:16:14.243454    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:16:14.245436 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:16:14.245411    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:17:58.035433 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.035393    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"]
Jul 27 21:17:58.039652 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.039631    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.042364 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.042344    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5f8eb8aa-serving-cert\""
Jul 27 21:17:58.042473 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.042449    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cgjq6\""
Jul 27 21:17:58.050651 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.050623    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"]
Jul 27 21:17:58.168638 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.168604    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqqcx\" (UniqueName: \"kubernetes.io/projected/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-kube-api-access-sqqcx\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.168942 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.168755    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.168942 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.168799    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-openshift-service-ca\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.270223 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.270180    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.270223 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.270223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-openshift-service-ca\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.270505 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.270282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqqcx\" (UniqueName: \"kubernetes.io/projected/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-kube-api-access-sqqcx\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.270505 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:17:58.270339    2566 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-serving-cert: secret "maas-api-e2e-ait-5f8eb8aa-serving-cert" not found
Jul 27 21:17:58.270505 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:17:58.270410    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls podName:8ef4d1e0-72fd-48e2-abb7-131be0c58a0b nodeName:}" failed. No retries permitted until 2026-07-27 21:17:58.770393433 +0000 UTC m=+1605.066724731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls") pod "maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp" (UID: "8ef4d1e0-72fd-48e2-abb7-131be0c58a0b") : secret "maas-api-e2e-ait-5f8eb8aa-serving-cert" not found
Jul 27 21:17:58.271073 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.271050    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-openshift-service-ca\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.279454 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.279429    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqqcx\" (UniqueName: \"kubernetes.io/projected/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-kube-api-access-sqqcx\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.774683 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.774648    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.777886 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.777859    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls\") pod \"maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:58.951600 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:58.951562    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:59.104369 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:59.104333    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"]
Jul 27 21:17:59.106038 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:17:59.105971    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef4d1e0_72fd_48e2_abb7_131be0c58a0b.slice/crio-597fbd8829b878b3c92f689ecda063c4d38d8d8b2bdca098bc07bb33dc178e5c WatchSource:0}: Error finding container 597fbd8829b878b3c92f689ecda063c4d38d8d8b2bdca098bc07bb33dc178e5c: Status 404 returned error can't find the container with id 597fbd8829b878b3c92f689ecda063c4d38d8d8b2bdca098bc07bb33dc178e5c
Jul 27 21:17:59.107826 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:59.107802    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:17:59.788818 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:59.788780    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp" event={"ID":"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b","Type":"ContainerStarted","Data":"375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48"}
Jul 27 21:17:59.789010 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:59.788853    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:17:59.789010 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:59.788877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp" event={"ID":"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b","Type":"ContainerStarted","Data":"597fbd8829b878b3c92f689ecda063c4d38d8d8b2bdca098bc07bb33dc178e5c"}
Jul 27 21:17:59.829427 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:17:59.829306    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp" podStartSLOduration=1.389410089 podStartE2EDuration="1.82928429s" totalImagesPullingTime="439.874201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:17:59.82711522 +0000 UTC m=+1606.123446539" watchObservedRunningTime="2026-07-27 21:17:59.82928429 +0000 UTC m=+1606.125615609"
Jul 27 21:18:05.799972 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:05.799942    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:18:33.989666 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:33.989630    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"]
Jul 27 21:18:33.990191 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:33.989913    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp" podUID="8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" containerName="maas-api" containerID="cri-o://375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48" gracePeriod=30
Jul 27 21:18:34.249347 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.249270    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:18:34.323494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.323463    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-openshift-service-ca\") pod \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") "
Jul 27 21:18:34.323494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.323499    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls\") pod \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") "
Jul 27 21:18:34.323753 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.323627    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqqcx\" (UniqueName: \"kubernetes.io/projected/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-kube-api-access-sqqcx\") pod \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\" (UID: \"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b\") "
Jul 27 21:18:34.323890 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.323866    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" (UID: "8ef4d1e0-72fd-48e2-abb7-131be0c58a0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:18:34.326058 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.326033    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" (UID: "8ef4d1e0-72fd-48e2-abb7-131be0c58a0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:18:34.326170 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.326146    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-kube-api-access-sqqcx" (OuterVolumeSpecName: "kube-api-access-sqqcx") pod "8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" (UID: "8ef4d1e0-72fd-48e2-abb7-131be0c58a0b"). InnerVolumeSpecName "kube-api-access-sqqcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:18:34.425258 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.425222    2566 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-openshift-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:18:34.425258 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.425255    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-maas-api-tls\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:18:34.425258 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.425264    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqqcx\" (UniqueName: \"kubernetes.io/projected/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b-kube-api-access-sqqcx\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:18:34.989807 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.989769    2566 generic.go:356] "Generic (PLEG): container finished" podID="8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" containerID="375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48" exitCode=0
Jul 27 21:18:34.990247 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.989832    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp" event={"ID":"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b","Type":"ContainerDied","Data":"375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48"}
Jul 27 21:18:34.990247 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.989906    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp" event={"ID":"8ef4d1e0-72fd-48e2-abb7-131be0c58a0b","Type":"ContainerDied","Data":"597fbd8829b878b3c92f689ecda063c4d38d8d8b2bdca098bc07bb33dc178e5c"}
Jul 27 21:18:34.990247 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.989836    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"
Jul 27 21:18:34.990247 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:34.989936    2566 scope.go:117] "RemoveContainer" containerID="375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48"
Jul 27 21:18:35.000330 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:35.000309    2566 scope.go:117] "RemoveContainer" containerID="375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48"
Jul 27 21:18:35.000692 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:18:35.000672    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48\": container with ID starting with 375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48 not found: ID does not exist" containerID="375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48"
Jul 27 21:18:35.000762 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:35.000701    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48"} err="failed to get container status \"375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48\": rpc error: code = NotFound desc = could not find container \"375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48\": container with ID starting with 375199cd52d50d2a32aff0ad6817c7f6b403527c0febc845c0cf28122930ef48 not found: ID does not exist"
Jul 27 21:18:35.013350 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:35.013317    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"]
Jul 27 21:18:35.017081 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:35.017049    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5f8eb8aa-65644cfbb4-8q2lp"]
Jul 27 21:18:36.244017 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:18:36.243983    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" path="/var/lib/kubelet/pods/8ef4d1e0-72fd-48e2-abb7-131be0c58a0b/volumes"
Jul 27 21:19:07.260369 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.260333    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"]
Jul 27 21:19:07.260874 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.260856    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" containerName="maas-api"
Jul 27 21:19:07.260936 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.260878    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" containerName="maas-api"
Jul 27 21:19:07.261005 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.260991    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ef4d1e0-72fd-48e2-abb7-131be0c58a0b" containerName="maas-api"
Jul 27 21:19:07.264239 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.264223    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"
Jul 27 21:19:07.267147 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.267126    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:19:07.273369 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.273343    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"]
Jul 27 21:19:07.346450 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.346410    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd08e1a7-628b-4953-8772-2c46e054b29e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh\" (UID: \"bd08e1a7-628b-4953-8772-2c46e054b29e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"
Jul 27 21:19:07.447145 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.447108    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd08e1a7-628b-4953-8772-2c46e054b29e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh\" (UID: \"bd08e1a7-628b-4953-8772-2c46e054b29e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"
Jul 27 21:19:07.447734 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.447716    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd08e1a7-628b-4953-8772-2c46e054b29e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh\" (UID: \"bd08e1a7-628b-4953-8772-2c46e054b29e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"
Jul 27 21:19:07.575864 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.575779    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"
Jul 27 21:19:07.714473 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:07.714445    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"]
Jul 27 21:19:07.716512 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:19:07.716482    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd08e1a7_628b_4953_8772_2c46e054b29e.slice/crio-7a982b685fe4d32a3001b4a623dc16ae80352ce4124e89013639bab1a016efca WatchSource:0}: Error finding container 7a982b685fe4d32a3001b4a623dc16ae80352ce4124e89013639bab1a016efca: Status 404 returned error can't find the container with id 7a982b685fe4d32a3001b4a623dc16ae80352ce4124e89013639bab1a016efca
Jul 27 21:19:08.175372 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:08.175332    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh" event={"ID":"bd08e1a7-628b-4953-8772-2c46e054b29e","Type":"ContainerStarted","Data":"7a982b685fe4d32a3001b4a623dc16ae80352ce4124e89013639bab1a016efca"}
Jul 27 21:19:11.193567 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:11.193463    2566 generic.go:356] "Generic (PLEG): container finished" podID="bd08e1a7-628b-4953-8772-2c46e054b29e" containerID="b8d2b95f75f8fc91da49b38deae49ce12393ab8b57b2a17beed6520fe68048ce" exitCode=0
Jul 27 21:19:11.193567 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:11.193502    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh" event={"ID":"bd08e1a7-628b-4953-8772-2c46e054b29e","Type":"ContainerDied","Data":"b8d2b95f75f8fc91da49b38deae49ce12393ab8b57b2a17beed6520fe68048ce"}
Jul 27 21:19:12.336816 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:12.336791    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"
Jul 27 21:19:12.394693 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:12.394657    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd08e1a7-628b-4953-8772-2c46e054b29e-maas-api-service-ca\") pod \"bd08e1a7-628b-4953-8772-2c46e054b29e\" (UID: \"bd08e1a7-628b-4953-8772-2c46e054b29e\") "
Jul 27 21:19:12.395063 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:12.395036    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd08e1a7-628b-4953-8772-2c46e054b29e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd08e1a7-628b-4953-8772-2c46e054b29e" (UID: "bd08e1a7-628b-4953-8772-2c46e054b29e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:19:12.496397 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:12.496361    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd08e1a7-628b-4953-8772-2c46e054b29e-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:19:13.212631 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:13.212590    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh" event={"ID":"bd08e1a7-628b-4953-8772-2c46e054b29e","Type":"ContainerDied","Data":"7a982b685fe4d32a3001b4a623dc16ae80352ce4124e89013639bab1a016efca"}
Jul 27 21:19:13.212631 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:13.212628    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"
Jul 27 21:19:13.212855 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:13.212683    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a982b685fe4d32a3001b4a623dc16ae80352ce4124e89013639bab1a016efca"
Jul 27 21:19:22.342646 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:22.342609    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"]
Jul 27 21:19:22.344824 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:22.344801    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-20b824d1-gnbbh"]
Jul 27 21:19:24.244354 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:19:24.244316    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd08e1a7-628b-4953-8772-2c46e054b29e" path="/var/lib/kubelet/pods/bd08e1a7-628b-4953-8772-2c46e054b29e/volumes"
Jul 27 21:20:35.445760 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.445717    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"]
Jul 27 21:20:35.446341 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.446322    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd08e1a7-628b-4953-8772-2c46e054b29e" containerName="revoke-keys"
Jul 27 21:20:35.446429 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.446344    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd08e1a7-628b-4953-8772-2c46e054b29e" containerName="revoke-keys"
Jul 27 21:20:35.446493 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.446477    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd08e1a7-628b-4953-8772-2c46e054b29e" containerName="revoke-keys"
Jul 27 21:20:35.449744 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.449723    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"
Jul 27 21:20:35.452171 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.452142    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:20:35.456872 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.456847    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"]
Jul 27 21:20:35.530392 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.530350    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88615e11-be1c-4674-b975-c625e78af248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a9503936-wvnqb\" (UID: \"88615e11-be1c-4674-b975-c625e78af248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"
Jul 27 21:20:35.631774 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.631732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88615e11-be1c-4674-b975-c625e78af248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a9503936-wvnqb\" (UID: \"88615e11-be1c-4674-b975-c625e78af248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"
Jul 27 21:20:35.632409 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.632382    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88615e11-be1c-4674-b975-c625e78af248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a9503936-wvnqb\" (UID: \"88615e11-be1c-4674-b975-c625e78af248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"
Jul 27 21:20:35.762081 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.762049    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"
Jul 27 21:20:35.905175 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:35.905148    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"]
Jul 27 21:20:35.906886 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:20:35.906857    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88615e11_be1c_4674_b975_c625e78af248.slice/crio-478df0bc403ef357384ff3e78e6347fc964b70597691a5a2d760d4531e2924db WatchSource:0}: Error finding container 478df0bc403ef357384ff3e78e6347fc964b70597691a5a2d760d4531e2924db: Status 404 returned error can't find the container with id 478df0bc403ef357384ff3e78e6347fc964b70597691a5a2d760d4531e2924db
Jul 27 21:20:36.652382 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:36.652346    2566 generic.go:356] "Generic (PLEG): container finished" podID="88615e11-be1c-4674-b975-c625e78af248" containerID="88101bc392e95b0df0a7ddd8e313813518a69ed7004b93e39b4e56fd2ffb1b02" exitCode=0
Jul 27 21:20:36.652833 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:36.652405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb" event={"ID":"88615e11-be1c-4674-b975-c625e78af248","Type":"ContainerDied","Data":"88101bc392e95b0df0a7ddd8e313813518a69ed7004b93e39b4e56fd2ffb1b02"}
Jul 27 21:20:36.652833 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:36.652451    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb" event={"ID":"88615e11-be1c-4674-b975-c625e78af248","Type":"ContainerStarted","Data":"478df0bc403ef357384ff3e78e6347fc964b70597691a5a2d760d4531e2924db"}
Jul 27 21:20:37.808021 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:37.807995    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"
Jul 27 21:20:37.954928 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:37.954835    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88615e11-be1c-4674-b975-c625e78af248-maas-api-service-ca\") pod \"88615e11-be1c-4674-b975-c625e78af248\" (UID: \"88615e11-be1c-4674-b975-c625e78af248\") "
Jul 27 21:20:37.955209 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:37.955184    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88615e11-be1c-4674-b975-c625e78af248-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88615e11-be1c-4674-b975-c625e78af248" (UID: "88615e11-be1c-4674-b975-c625e78af248"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:20:38.055808 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:38.055770    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88615e11-be1c-4674-b975-c625e78af248-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:20:38.665863 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:38.665779    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb" event={"ID":"88615e11-be1c-4674-b975-c625e78af248","Type":"ContainerDied","Data":"478df0bc403ef357384ff3e78e6347fc964b70597691a5a2d760d4531e2924db"}
Jul 27 21:20:38.665863 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:38.665820    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"
Jul 27 21:20:38.666042 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:38.665826    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="478df0bc403ef357384ff3e78e6347fc964b70597691a5a2d760d4531e2924db"
Jul 27 21:20:50.531023 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:50.530987    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"]
Jul 27 21:20:50.533923 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:50.533899    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9503936-wvnqb"]
Jul 27 21:20:52.244370 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:20:52.244332    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88615e11-be1c-4674-b975-c625e78af248" path="/var/lib/kubelet/pods/88615e11-be1c-4674-b975-c625e78af248/volumes"
Jul 27 21:21:14.275501 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:21:14.275472    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:21:14.286803 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:21:14.286772    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:24:24.280821 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.280785    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"]
Jul 27 21:24:24.281286 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.281187    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88615e11-be1c-4674-b975-c625e78af248" containerName="revoke-keys"
Jul 27 21:24:24.281286 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.281209    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="88615e11-be1c-4674-b975-c625e78af248" containerName="revoke-keys"
Jul 27 21:24:24.281363 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.281289    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="88615e11-be1c-4674-b975-c625e78af248" containerName="revoke-keys"
Jul 27 21:24:24.284227 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.284209    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"
Jul 27 21:24:24.286800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.286777    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:24:24.293097 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.293073    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"]
Jul 27 21:24:24.413299 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.413267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7b08d-c2d9-4cfe-8e80-6e452d7c357c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr\" (UID: \"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"
Jul 27 21:24:24.514901 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.514855    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7b08d-c2d9-4cfe-8e80-6e452d7c357c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr\" (UID: \"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"
Jul 27 21:24:24.515506 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.515487    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7b08d-c2d9-4cfe-8e80-6e452d7c357c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr\" (UID: \"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"
Jul 27 21:24:24.596813 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.596730    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"
Jul 27 21:24:24.737444 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.737372    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"]
Jul 27 21:24:24.740682 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:24:24.740635    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a7b08d_c2d9_4cfe_8e80_6e452d7c357c.slice/crio-f78abaa2df8cc13a0964bd5f391f80019c8d82f445e2b35df3c43ac9ca9a8b62 WatchSource:0}: Error finding container f78abaa2df8cc13a0964bd5f391f80019c8d82f445e2b35df3c43ac9ca9a8b62: Status 404 returned error can't find the container with id f78abaa2df8cc13a0964bd5f391f80019c8d82f445e2b35df3c43ac9ca9a8b62
Jul 27 21:24:24.895292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:24.895201    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr" event={"ID":"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c","Type":"ContainerStarted","Data":"f78abaa2df8cc13a0964bd5f391f80019c8d82f445e2b35df3c43ac9ca9a8b62"}
Jul 27 21:24:25.902783 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:25.902684    2566 generic.go:356] "Generic (PLEG): container finished" podID="82a7b08d-c2d9-4cfe-8e80-6e452d7c357c" containerID="4931884da691cb16f896629342718290f7ddbdb13adfe90dafca94b119ef8aa6" exitCode=0
Jul 27 21:24:25.903151 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:25.902773    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr" event={"ID":"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c","Type":"ContainerDied","Data":"4931884da691cb16f896629342718290f7ddbdb13adfe90dafca94b119ef8aa6"}
Jul 27 21:24:27.045309 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:27.045286    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"
Jul 27 21:24:27.142969 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:27.142931    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7b08d-c2d9-4cfe-8e80-6e452d7c357c-maas-api-service-ca\") pod \"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c\" (UID: \"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c\") "
Jul 27 21:24:27.143340 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:27.143318    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a7b08d-c2d9-4cfe-8e80-6e452d7c357c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82a7b08d-c2d9-4cfe-8e80-6e452d7c357c" (UID: "82a7b08d-c2d9-4cfe-8e80-6e452d7c357c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:24:27.244568 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:27.244500    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7b08d-c2d9-4cfe-8e80-6e452d7c357c-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:24:27.914813 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:27.914786    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"
Jul 27 21:24:27.914813 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:27.914813    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr" event={"ID":"82a7b08d-c2d9-4cfe-8e80-6e452d7c357c","Type":"ContainerDied","Data":"f78abaa2df8cc13a0964bd5f391f80019c8d82f445e2b35df3c43ac9ca9a8b62"}
Jul 27 21:24:27.915041 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:27.914855    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f78abaa2df8cc13a0964bd5f391f80019c8d82f445e2b35df3c43ac9ca9a8b62"
Jul 27 21:24:44.379927 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:44.379893    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"]
Jul 27 21:24:44.384083 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:44.384052    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-316c1e32-9ppzr"]
Jul 27 21:24:46.244169 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:24:46.244133    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a7b08d-c2d9-4cfe-8e80-6e452d7c357c" path="/var/lib/kubelet/pods/82a7b08d-c2d9-4cfe-8e80-6e452d7c357c/volumes"
Jul 27 21:25:15.602578 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:25:15.602526    2566 scope.go:117] "RemoveContainer" containerID="b8d2b95f75f8fc91da49b38deae49ce12393ab8b57b2a17beed6520fe68048ce"
Jul 27 21:26:14.316686 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:14.316651    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:26:14.321680 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:14.321654    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:26:48.108154 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.108108    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"]
Jul 27 21:26:48.108856 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.108699    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a7b08d-c2d9-4cfe-8e80-6e452d7c357c" containerName="revoke-keys"
Jul 27 21:26:48.108856 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.108719    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a7b08d-c2d9-4cfe-8e80-6e452d7c357c" containerName="revoke-keys"
Jul 27 21:26:48.108856 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.108828    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a7b08d-c2d9-4cfe-8e80-6e452d7c357c" containerName="revoke-keys"
Jul 27 21:26:48.111799 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.111777    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.115871 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.115842    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-0adc64\""
Jul 27 21:26:48.115871 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.115861    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-0adc64-dockercfg-wdprc\""
Jul 27 21:26:48.139634 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.139602    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"]
Jul 27 21:26:48.197550 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.197489    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvv9\" (UniqueName: \"kubernetes.io/projected/1ac259bc-1d6b-4c19-9d54-ee0163173399-kube-api-access-mcvv9\") pod \"payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.197754 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.197641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac259bc-1d6b-4c19-9d54-ee0163173399-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.299323 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.299282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvv9\" (UniqueName: \"kubernetes.io/projected/1ac259bc-1d6b-4c19-9d54-ee0163173399-kube-api-access-mcvv9\") pod \"payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.299508 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.299393    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac259bc-1d6b-4c19-9d54-ee0163173399-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.300234 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.300206    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac259bc-1d6b-4c19-9d54-ee0163173399-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.310143 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.310113    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvv9\" (UniqueName: \"kubernetes.io/projected/1ac259bc-1d6b-4c19-9d54-ee0163173399-kube-api-access-mcvv9\") pod \"payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.426149 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.426054    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.580280 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.580249    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"]
Jul 27 21:26:48.581742 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:26:48.581708    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac259bc_1d6b_4c19_9d54_ee0163173399.slice/crio-4fd0666ef8270fcf8c79a0c86227fe8bf1e6116617be2461120731bd0959bc62 WatchSource:0}: Error finding container 4fd0666ef8270fcf8c79a0c86227fe8bf1e6116617be2461120731bd0959bc62: Status 404 returned error can't find the container with id 4fd0666ef8270fcf8c79a0c86227fe8bf1e6116617be2461120731bd0959bc62
Jul 27 21:26:48.684116 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.684022    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4" event={"ID":"1ac259bc-1d6b-4c19-9d54-ee0163173399","Type":"ContainerStarted","Data":"cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5"}
Jul 27 21:26:48.684116 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.684075    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4" event={"ID":"1ac259bc-1d6b-4c19-9d54-ee0163173399","Type":"ContainerStarted","Data":"4fd0666ef8270fcf8c79a0c86227fe8bf1e6116617be2461120731bd0959bc62"}
Jul 27 21:26:48.684116 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.684106    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:26:48.710014 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:48.709948    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4" podStartSLOduration=0.709929745 podStartE2EDuration="709.929745ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:26:48.709033838 +0000 UTC m=+2135.005365161" watchObservedRunningTime="2026-07-27 21:26:48.709929745 +0000 UTC m=+2135.006261062"
Jul 27 21:26:59.692095 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:26:59.692066    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:27:15.631926 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:27:15.631891    2566 scope.go:117] "RemoveContainer" containerID="88101bc392e95b0df0a7ddd8e313813518a69ed7004b93e39b4e56fd2ffb1b02"
Jul 27 21:28:21.997191 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:21.997150    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"]
Jul 27 21:28:22.000580 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.000561    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"
Jul 27 21:28:22.005852 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.005822    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:28:22.018959 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.018926    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"]
Jul 27 21:28:22.111263 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.111223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/368160ce-b805-4cfe-ad3b-8e326a7b813b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-edfab0-sck54\" (UID: \"368160ce-b805-4cfe-ad3b-8e326a7b813b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"
Jul 27 21:28:22.212817 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.212778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/368160ce-b805-4cfe-ad3b-8e326a7b813b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-edfab0-sck54\" (UID: \"368160ce-b805-4cfe-ad3b-8e326a7b813b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"
Jul 27 21:28:22.213447 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.213417    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/368160ce-b805-4cfe-ad3b-8e326a7b813b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-edfab0-sck54\" (UID: \"368160ce-b805-4cfe-ad3b-8e326a7b813b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"
Jul 27 21:28:22.313394 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.313292    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"
Jul 27 21:28:22.471978 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:28:22.471943    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368160ce_b805_4cfe_ad3b_8e326a7b813b.slice/crio-303a3a247b1d6c4fbd8363416d003ff42365cf79960775afeeeb898d3dac2b4a WatchSource:0}: Error finding container 303a3a247b1d6c4fbd8363416d003ff42365cf79960775afeeeb898d3dac2b4a: Status 404 returned error can't find the container with id 303a3a247b1d6c4fbd8363416d003ff42365cf79960775afeeeb898d3dac2b4a
Jul 27 21:28:22.472807 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:22.472778    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"]
Jul 27 21:28:23.217339 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:23.217302    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54" event={"ID":"368160ce-b805-4cfe-ad3b-8e326a7b813b","Type":"ContainerStarted","Data":"580ed3be3b4167910437a7d780f5b0d43e998802f8cd1d44886c1b7d6cb78cb2"}
Jul 27 21:28:23.217793 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:23.217354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54" event={"ID":"368160ce-b805-4cfe-ad3b-8e326a7b813b","Type":"ContainerStarted","Data":"303a3a247b1d6c4fbd8363416d003ff42365cf79960775afeeeb898d3dac2b4a"}
Jul 27 21:28:23.247867 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:23.247809    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54" podStartSLOduration=2.247791186 podStartE2EDuration="2.247791186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:28:23.246754711 +0000 UTC m=+2229.543086030" watchObservedRunningTime="2026-07-27 21:28:23.247791186 +0000 UTC m=+2229.544122504"
Jul 27 21:28:24.223723 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:24.223689    2566 generic.go:356] "Generic (PLEG): container finished" podID="368160ce-b805-4cfe-ad3b-8e326a7b813b" containerID="580ed3be3b4167910437a7d780f5b0d43e998802f8cd1d44886c1b7d6cb78cb2" exitCode=0
Jul 27 21:28:24.224143 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:24.223729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54" event={"ID":"368160ce-b805-4cfe-ad3b-8e326a7b813b","Type":"ContainerDied","Data":"580ed3be3b4167910437a7d780f5b0d43e998802f8cd1d44886c1b7d6cb78cb2"}
Jul 27 21:28:25.370088 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:25.370059    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"
Jul 27 21:28:25.544518 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:25.544474    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/368160ce-b805-4cfe-ad3b-8e326a7b813b-maas-api-service-ca\") pod \"368160ce-b805-4cfe-ad3b-8e326a7b813b\" (UID: \"368160ce-b805-4cfe-ad3b-8e326a7b813b\") "
Jul 27 21:28:25.544863 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:25.544835    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/368160ce-b805-4cfe-ad3b-8e326a7b813b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "368160ce-b805-4cfe-ad3b-8e326a7b813b" (UID: "368160ce-b805-4cfe-ad3b-8e326a7b813b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:28:25.645426 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:25.645389    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/368160ce-b805-4cfe-ad3b-8e326a7b813b-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:28:26.236155 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:26.236119    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"
Jul 27 21:28:26.236155 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:26.236146    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54" event={"ID":"368160ce-b805-4cfe-ad3b-8e326a7b813b","Type":"ContainerDied","Data":"303a3a247b1d6c4fbd8363416d003ff42365cf79960775afeeeb898d3dac2b4a"}
Jul 27 21:28:26.236421 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:26.236221    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="303a3a247b1d6c4fbd8363416d003ff42365cf79960775afeeeb898d3dac2b4a"
Jul 27 21:28:37.179765 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:37.179675    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"]
Jul 27 21:28:37.190112 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:37.190079    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-edfab0-sck54"]
Jul 27 21:28:38.243587 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:38.243519    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="368160ce-b805-4cfe-ad3b-8e326a7b813b" path="/var/lib/kubelet/pods/368160ce-b805-4cfe-ad3b-8e326a7b813b/volumes"
Jul 27 21:28:56.051054 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.051016    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"]
Jul 27 21:28:56.051626 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.051279    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4" podUID="1ac259bc-1d6b-4c19-9d54-ee0163173399" containerName="payload-pre-processing" containerID="cri-o://cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5" gracePeriod=30
Jul 27 21:28:56.323516 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.323439    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:28:56.404798 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.404756    2566 generic.go:356] "Generic (PLEG): container finished" podID="1ac259bc-1d6b-4c19-9d54-ee0163173399" containerID="cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5" exitCode=0
Jul 27 21:28:56.405058 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.404854    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"
Jul 27 21:28:56.405058 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.404892    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4" event={"ID":"1ac259bc-1d6b-4c19-9d54-ee0163173399","Type":"ContainerDied","Data":"cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5"}
Jul 27 21:28:56.405058 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.404970    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4" event={"ID":"1ac259bc-1d6b-4c19-9d54-ee0163173399","Type":"ContainerDied","Data":"4fd0666ef8270fcf8c79a0c86227fe8bf1e6116617be2461120731bd0959bc62"}
Jul 27 21:28:56.405058 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.404992    2566 scope.go:117] "RemoveContainer" containerID="cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5"
Jul 27 21:28:56.414263 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.414242    2566 scope.go:117] "RemoveContainer" containerID="cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5"
Jul 27 21:28:56.414646 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:28:56.414624    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5\": container with ID starting with cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5 not found: ID does not exist" containerID="cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5"
Jul 27 21:28:56.414706 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.414657    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5"} err="failed to get container status \"cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5\": rpc error: code = NotFound desc = could not find container \"cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5\": container with ID starting with cfa95e398c4a36a8031e64ac7b5a536faacbcac6db351764ef9d60f2ab1c88e5 not found: ID does not exist"
Jul 27 21:28:56.442094 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.442063    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac259bc-1d6b-4c19-9d54-ee0163173399-plugins-config-volume\") pod \"1ac259bc-1d6b-4c19-9d54-ee0163173399\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") "
Jul 27 21:28:56.442287 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.442216    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcvv9\" (UniqueName: \"kubernetes.io/projected/1ac259bc-1d6b-4c19-9d54-ee0163173399-kube-api-access-mcvv9\") pod \"1ac259bc-1d6b-4c19-9d54-ee0163173399\" (UID: \"1ac259bc-1d6b-4c19-9d54-ee0163173399\") "
Jul 27 21:28:56.442561 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.442502    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac259bc-1d6b-4c19-9d54-ee0163173399-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ac259bc-1d6b-4c19-9d54-ee0163173399" (UID: "1ac259bc-1d6b-4c19-9d54-ee0163173399"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:28:56.444686 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.444661    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac259bc-1d6b-4c19-9d54-ee0163173399-kube-api-access-mcvv9" (OuterVolumeSpecName: "kube-api-access-mcvv9") pod "1ac259bc-1d6b-4c19-9d54-ee0163173399" (UID: "1ac259bc-1d6b-4c19-9d54-ee0163173399"). InnerVolumeSpecName "kube-api-access-mcvv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:28:56.543112 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.543077    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcvv9\" (UniqueName: \"kubernetes.io/projected/1ac259bc-1d6b-4c19-9d54-ee0163173399-kube-api-access-mcvv9\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:28:56.543112 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.543105    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ac259bc-1d6b-4c19-9d54-ee0163173399-plugins-config-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:28:56.737353 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.737317    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"]
Jul 27 21:28:56.744574 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:56.744547    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-0adc64-5c9b8d6fbd-jlpc4"]
Jul 27 21:28:58.244138 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:28:58.244104    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac259bc-1d6b-4c19-9d54-ee0163173399" path="/var/lib/kubelet/pods/1ac259bc-1d6b-4c19-9d54-ee0163173399/volumes"
Jul 27 21:29:32.914277 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.914230    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"]
Jul 27 21:29:32.914786 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.914665    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac259bc-1d6b-4c19-9d54-ee0163173399" containerName="payload-pre-processing"
Jul 27 21:29:32.914786 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.914678    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac259bc-1d6b-4c19-9d54-ee0163173399" containerName="payload-pre-processing"
Jul 27 21:29:32.914786 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.914687    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368160ce-b805-4cfe-ad3b-8e326a7b813b" containerName="revoke-keys"
Jul 27 21:29:32.914786 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.914692    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="368160ce-b805-4cfe-ad3b-8e326a7b813b" containerName="revoke-keys"
Jul 27 21:29:32.914786 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.914768    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="368160ce-b805-4cfe-ad3b-8e326a7b813b" containerName="revoke-keys"
Jul 27 21:29:32.914786 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.914779    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac259bc-1d6b-4c19-9d54-ee0163173399" containerName="payload-pre-processing"
Jul 27 21:29:32.918095 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.918080    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"
Jul 27 21:29:32.921741 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.921715    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:29:32.928985 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.928961    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"]
Jul 27 21:29:32.986973 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:32.986933    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16a9fbc3-a029-4287-8142-58ecf9cb634c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m\" (UID: \"16a9fbc3-a029-4287-8142-58ecf9cb634c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"
Jul 27 21:29:33.087985 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:33.087939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16a9fbc3-a029-4287-8142-58ecf9cb634c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m\" (UID: \"16a9fbc3-a029-4287-8142-58ecf9cb634c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"
Jul 27 21:29:33.088696 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:33.088675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16a9fbc3-a029-4287-8142-58ecf9cb634c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m\" (UID: \"16a9fbc3-a029-4287-8142-58ecf9cb634c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"
Jul 27 21:29:33.228975 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:33.228875    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"
Jul 27 21:29:33.385356 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:33.385296    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"]
Jul 27 21:29:33.388361 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:29:33.388316    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a9fbc3_a029_4287_8142_58ecf9cb634c.slice/crio-2a1b7d66aa4d96c28f21faba6a0ce7405f01cc6e07d15bf23b53890458fd14a1 WatchSource:0}: Error finding container 2a1b7d66aa4d96c28f21faba6a0ce7405f01cc6e07d15bf23b53890458fd14a1: Status 404 returned error can't find the container with id 2a1b7d66aa4d96c28f21faba6a0ce7405f01cc6e07d15bf23b53890458fd14a1
Jul 27 21:29:33.622128 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:33.622093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m" event={"ID":"16a9fbc3-a029-4287-8142-58ecf9cb634c","Type":"ContainerStarted","Data":"2a1b7d66aa4d96c28f21faba6a0ce7405f01cc6e07d15bf23b53890458fd14a1"}
Jul 27 21:29:34.629065 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:34.629029    2566 generic.go:356] "Generic (PLEG): container finished" podID="16a9fbc3-a029-4287-8142-58ecf9cb634c" containerID="0a55277c128345f7fa998b13a39580f8438850e6a82d913420d4474e4cb14c36" exitCode=0
Jul 27 21:29:34.629065 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:34.629070    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m" event={"ID":"16a9fbc3-a029-4287-8142-58ecf9cb634c","Type":"ContainerDied","Data":"0a55277c128345f7fa998b13a39580f8438850e6a82d913420d4474e4cb14c36"}
Jul 27 21:29:35.768622 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:35.768593    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"
Jul 27 21:29:35.812989 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:35.812939    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16a9fbc3-a029-4287-8142-58ecf9cb634c-maas-api-service-ca\") pod \"16a9fbc3-a029-4287-8142-58ecf9cb634c\" (UID: \"16a9fbc3-a029-4287-8142-58ecf9cb634c\") "
Jul 27 21:29:35.813293 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:35.813270    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16a9fbc3-a029-4287-8142-58ecf9cb634c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "16a9fbc3-a029-4287-8142-58ecf9cb634c" (UID: "16a9fbc3-a029-4287-8142-58ecf9cb634c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:35.914129 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:35.914034    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16a9fbc3-a029-4287-8142-58ecf9cb634c-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:29:36.641253 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:36.641165    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"
Jul 27 21:29:36.641253 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:36.641200    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m" event={"ID":"16a9fbc3-a029-4287-8142-58ecf9cb634c","Type":"ContainerDied","Data":"2a1b7d66aa4d96c28f21faba6a0ce7405f01cc6e07d15bf23b53890458fd14a1"}
Jul 27 21:29:36.641253 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:36.641254    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a1b7d66aa4d96c28f21faba6a0ce7405f01cc6e07d15bf23b53890458fd14a1"
Jul 27 21:29:53.071793 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:53.071752    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"]
Jul 27 21:29:53.082891 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:53.082847    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c3ee91-v9f9m"]
Jul 27 21:29:54.244012 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:29:54.243980    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16a9fbc3-a029-4287-8142-58ecf9cb634c" path="/var/lib/kubelet/pods/16a9fbc3-a029-4287-8142-58ecf9cb634c/volumes"
Jul 27 21:30:00.367815 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.367777    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"]
Jul 27 21:30:00.368274 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.368172    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16a9fbc3-a029-4287-8142-58ecf9cb634c" containerName="revoke-keys"
Jul 27 21:30:00.368274 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.368183    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="16a9fbc3-a029-4287-8142-58ecf9cb634c" containerName="revoke-keys"
Jul 27 21:30:00.368274 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.368262    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="16a9fbc3-a029-4287-8142-58ecf9cb634c" containerName="revoke-keys"
Jul 27 21:30:00.371603 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.371585    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"
Jul 27 21:30:00.375511 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.375487    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:30:00.382400 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.382371    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"]
Jul 27 21:30:00.452896 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.452865    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/774b151c-c566-4e78-8712-0dee16b071b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5\" (UID: \"774b151c-c566-4e78-8712-0dee16b071b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"
Jul 27 21:30:00.553946 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.553911    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/774b151c-c566-4e78-8712-0dee16b071b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5\" (UID: \"774b151c-c566-4e78-8712-0dee16b071b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"
Jul 27 21:30:00.554580 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.554559    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/774b151c-c566-4e78-8712-0dee16b071b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5\" (UID: \"774b151c-c566-4e78-8712-0dee16b071b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"
Jul 27 21:30:00.682519 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:00.682423    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"
Jul 27 21:30:01.034587 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:01.034559    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"]
Jul 27 21:30:01.036729 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:30:01.036705    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774b151c_c566_4e78_8712_0dee16b071b2.slice/crio-2e7f7c1e27de752e9fb3ffffbd5dd2cbfbf4b88c6f0d6c4e9d59a8fd54c56fdb WatchSource:0}: Error finding container 2e7f7c1e27de752e9fb3ffffbd5dd2cbfbf4b88c6f0d6c4e9d59a8fd54c56fdb: Status 404 returned error can't find the container with id 2e7f7c1e27de752e9fb3ffffbd5dd2cbfbf4b88c6f0d6c4e9d59a8fd54c56fdb
Jul 27 21:30:01.788347 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:01.788313    2566 generic.go:356] "Generic (PLEG): container finished" podID="774b151c-c566-4e78-8712-0dee16b071b2" containerID="c02249f2405df2be09f154e40eca83aff5c44691e9f701e73fc1bc44de0aa9d4" exitCode=0
Jul 27 21:30:01.788814 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:01.788397    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5" event={"ID":"774b151c-c566-4e78-8712-0dee16b071b2","Type":"ContainerDied","Data":"c02249f2405df2be09f154e40eca83aff5c44691e9f701e73fc1bc44de0aa9d4"}
Jul 27 21:30:01.788814 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:01.788449    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5" event={"ID":"774b151c-c566-4e78-8712-0dee16b071b2","Type":"ContainerStarted","Data":"2e7f7c1e27de752e9fb3ffffbd5dd2cbfbf4b88c6f0d6c4e9d59a8fd54c56fdb"}
Jul 27 21:30:02.936908 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:02.936877    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"
Jul 27 21:30:02.971894 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:02.971865    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/774b151c-c566-4e78-8712-0dee16b071b2-maas-api-service-ca\") pod \"774b151c-c566-4e78-8712-0dee16b071b2\" (UID: \"774b151c-c566-4e78-8712-0dee16b071b2\") "
Jul 27 21:30:02.972212 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:02.972190    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774b151c-c566-4e78-8712-0dee16b071b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "774b151c-c566-4e78-8712-0dee16b071b2" (UID: "774b151c-c566-4e78-8712-0dee16b071b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:03.073235 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:03.073146    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/774b151c-c566-4e78-8712-0dee16b071b2-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:30:03.801313 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:03.801281    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"
Jul 27 21:30:03.801313 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:03.801295    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5" event={"ID":"774b151c-c566-4e78-8712-0dee16b071b2","Type":"ContainerDied","Data":"2e7f7c1e27de752e9fb3ffffbd5dd2cbfbf4b88c6f0d6c4e9d59a8fd54c56fdb"}
Jul 27 21:30:03.801608 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:03.801344    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e7f7c1e27de752e9fb3ffffbd5dd2cbfbf4b88c6f0d6c4e9d59a8fd54c56fdb"
Jul 27 21:30:20.453939 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:20.453903    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"]
Jul 27 21:30:20.457664 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:20.457639    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-86cc77-fv4w5"]
Jul 27 21:30:22.243217 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:30:22.243180    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774b151c-c566-4e78-8712-0dee16b071b2" path="/var/lib/kubelet/pods/774b151c-c566-4e78-8712-0dee16b071b2/volumes"
Jul 27 21:31:14.356368 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:31:14.356336    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:31:14.363570 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:31:14.363527    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:31:15.681999 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:31:15.681963    2566 scope.go:117] "RemoveContainer" containerID="4931884da691cb16f896629342718290f7ddbdb13adfe90dafca94b119ef8aa6"
Jul 27 21:35:15.727908 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:35:15.727875    2566 scope.go:117] "RemoveContainer" containerID="580ed3be3b4167910437a7d780f5b0d43e998802f8cd1d44886c1b7d6cb78cb2"
Jul 27 21:36:14.391176 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:36:14.391053    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:36:14.399417 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:36:14.399389    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:36:15.749149 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:36:15.749116    2566 scope.go:117] "RemoveContainer" containerID="c02249f2405df2be09f154e40eca83aff5c44691e9f701e73fc1bc44de0aa9d4"
Jul 27 21:36:15.758086 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:36:15.758062    2566 scope.go:117] "RemoveContainer" containerID="0a55277c128345f7fa998b13a39580f8438850e6a82d913420d4474e4cb14c36"
Jul 27 21:39:32.571673 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.571642    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7115-140245860479664"]
Jul 27 21:39:32.572134 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.572067    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774b151c-c566-4e78-8712-0dee16b071b2" containerName="revoke-keys"
Jul 27 21:39:32.572134 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.572080    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="774b151c-c566-4e78-8712-0dee16b071b2" containerName="revoke-keys"
Jul 27 21:39:32.572208 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.572168    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="774b151c-c566-4e78-8712-0dee16b071b2" containerName="revoke-keys"
Jul 27 21:39:32.575283 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.575267    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:32.578076 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.578047    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jq5dl\""
Jul 27 21:39:32.582433 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.582404    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860479664"]
Jul 27 21:39:32.708745 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.708688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp4dt\" (UniqueName: \"kubernetes.io/projected/020f33e4-30c0-49ff-9d2a-358e8e590f8b-kube-api-access-rp4dt\") pod \"test-curl-7115-140245860479664\" (UID: \"020f33e4-30c0-49ff-9d2a-358e8e590f8b\") " pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:32.810208 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.810144    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp4dt\" (UniqueName: \"kubernetes.io/projected/020f33e4-30c0-49ff-9d2a-358e8e590f8b-kube-api-access-rp4dt\") pod \"test-curl-7115-140245860479664\" (UID: \"020f33e4-30c0-49ff-9d2a-358e8e590f8b\") " pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:32.818830 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.818805    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp4dt\" (UniqueName: \"kubernetes.io/projected/020f33e4-30c0-49ff-9d2a-358e8e590f8b-kube-api-access-rp4dt\") pod \"test-curl-7115-140245860479664\" (UID: \"020f33e4-30c0-49ff-9d2a-358e8e590f8b\") " pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:32.892214 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:32.892120    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:33.036608 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:33.035520    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860479664"]
Jul 27 21:39:33.040214 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:39:33.040181    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod020f33e4_30c0_49ff_9d2a_358e8e590f8b.slice/crio-3317d485d9e330387c4c8bc5f377a6536a69c3ea4b25d7afb55dcb4ac6efaa5c WatchSource:0}: Error finding container 3317d485d9e330387c4c8bc5f377a6536a69c3ea4b25d7afb55dcb4ac6efaa5c: Status 404 returned error can't find the container with id 3317d485d9e330387c4c8bc5f377a6536a69c3ea4b25d7afb55dcb4ac6efaa5c
Jul 27 21:39:33.041449 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:33.041430    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:39:33.968082 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:33.967990    2566 generic.go:356] "Generic (PLEG): container finished" podID="020f33e4-30c0-49ff-9d2a-358e8e590f8b" containerID="5dd5705047f5659a896d18a32e4af3a468ab3cde5f11f3b2c4e48c67f170492a" exitCode=0
Jul 27 21:39:33.968435 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:33.968077    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860479664" event={"ID":"020f33e4-30c0-49ff-9d2a-358e8e590f8b","Type":"ContainerDied","Data":"5dd5705047f5659a896d18a32e4af3a468ab3cde5f11f3b2c4e48c67f170492a"}
Jul 27 21:39:33.968435 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:33.968117    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860479664" event={"ID":"020f33e4-30c0-49ff-9d2a-358e8e590f8b","Type":"ContainerStarted","Data":"3317d485d9e330387c4c8bc5f377a6536a69c3ea4b25d7afb55dcb4ac6efaa5c"}
Jul 27 21:39:35.124134 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.124106    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:35.131099 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.131069    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp4dt\" (UniqueName: \"kubernetes.io/projected/020f33e4-30c0-49ff-9d2a-358e8e590f8b-kube-api-access-rp4dt\") pod \"020f33e4-30c0-49ff-9d2a-358e8e590f8b\" (UID: \"020f33e4-30c0-49ff-9d2a-358e8e590f8b\") "
Jul 27 21:39:35.133265 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.133234    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020f33e4-30c0-49ff-9d2a-358e8e590f8b-kube-api-access-rp4dt" (OuterVolumeSpecName: "kube-api-access-rp4dt") pod "020f33e4-30c0-49ff-9d2a-358e8e590f8b" (UID: "020f33e4-30c0-49ff-9d2a-358e8e590f8b"). InnerVolumeSpecName "kube-api-access-rp4dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:35.159313 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.159289    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7115-140245860479664_020f33e4-30c0-49ff-9d2a-358e8e590f8b/test-curl-7115-140245860479664/0.log"
Jul 27 21:39:35.181948 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.181913    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7115-140245860479664"]
Jul 27 21:39:35.185673 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.185638    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7115-140245860479664"]
Jul 27 21:39:35.232495 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.232408    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp4dt\" (UniqueName: \"kubernetes.io/projected/020f33e4-30c0-49ff-9d2a-358e8e590f8b-kube-api-access-rp4dt\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:39:35.317508 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.317468    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7115-140245860458800"]
Jul 27 21:39:35.317909 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.317895    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020f33e4-30c0-49ff-9d2a-358e8e590f8b" containerName="test-curl-7115-140245860479664"
Jul 27 21:39:35.317955 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.317911    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="020f33e4-30c0-49ff-9d2a-358e8e590f8b" containerName="test-curl-7115-140245860479664"
Jul 27 21:39:35.318001 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.317991    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="020f33e4-30c0-49ff-9d2a-358e8e590f8b" containerName="test-curl-7115-140245860479664"
Jul 27 21:39:35.321203 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.321188    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860458800"
Jul 27 21:39:35.332057 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.332026    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860458800"]
Jul 27 21:39:35.333197 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.333171    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml5zv\" (UniqueName: \"kubernetes.io/projected/7aa19403-d5dd-4dff-868c-3581db6d3094-kube-api-access-ml5zv\") pod \"test-curl-7115-140245860458800\" (UID: \"7aa19403-d5dd-4dff-868c-3581db6d3094\") " pod="opendatahub/test-curl-7115-140245860458800"
Jul 27 21:39:35.434352 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.434318    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml5zv\" (UniqueName: \"kubernetes.io/projected/7aa19403-d5dd-4dff-868c-3581db6d3094-kube-api-access-ml5zv\") pod \"test-curl-7115-140245860458800\" (UID: \"7aa19403-d5dd-4dff-868c-3581db6d3094\") " pod="opendatahub/test-curl-7115-140245860458800"
Jul 27 21:39:35.443133 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.443107    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml5zv\" (UniqueName: \"kubernetes.io/projected/7aa19403-d5dd-4dff-868c-3581db6d3094-kube-api-access-ml5zv\") pod \"test-curl-7115-140245860458800\" (UID: \"7aa19403-d5dd-4dff-868c-3581db6d3094\") " pod="opendatahub/test-curl-7115-140245860458800"
Jul 27 21:39:35.630667 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.630629    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860458800"
Jul 27 21:39:35.784408 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.784382    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860458800"]
Jul 27 21:39:35.786386 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:39:35.786356    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7aa19403_d5dd_4dff_868c_3581db6d3094.slice/crio-503f66ac9170cb06a1578bb150cbbd68eef419bb7405893774c3753f3b956335 WatchSource:0}: Error finding container 503f66ac9170cb06a1578bb150cbbd68eef419bb7405893774c3753f3b956335: Status 404 returned error can't find the container with id 503f66ac9170cb06a1578bb150cbbd68eef419bb7405893774c3753f3b956335
Jul 27 21:39:35.979513 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.979428    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:35.979513 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.979473    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3317d485d9e330387c4c8bc5f377a6536a69c3ea4b25d7afb55dcb4ac6efaa5c"
Jul 27 21:39:35.980654 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:35.980630    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860458800" event={"ID":"7aa19403-d5dd-4dff-868c-3581db6d3094","Type":"ContainerStarted","Data":"503f66ac9170cb06a1578bb150cbbd68eef419bb7405893774c3753f3b956335"}
Jul 27 21:39:35.990130 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:39:35.990102    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7115-140245860479664\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" podUID="020f33e4-30c0-49ff-9d2a-358e8e590f8b" pod="opendatahub/test-curl-7115-140245860479664"
Jul 27 21:39:36.244450 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:36.244407    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="020f33e4-30c0-49ff-9d2a-358e8e590f8b" path="/var/lib/kubelet/pods/020f33e4-30c0-49ff-9d2a-358e8e590f8b/volumes"
Jul 27 21:39:36.987617 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:36.987583    2566 generic.go:356] "Generic (PLEG): container finished" podID="7aa19403-d5dd-4dff-868c-3581db6d3094" containerID="3d66b2e1dced8a85024bb5a66ca7876376533aa43454c4c21bdc3e98716188e1" exitCode=0
Jul 27 21:39:36.987816 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:36.987663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860458800" event={"ID":"7aa19403-d5dd-4dff-868c-3581db6d3094","Type":"ContainerDied","Data":"3d66b2e1dced8a85024bb5a66ca7876376533aa43454c4c21bdc3e98716188e1"}
Jul 27 21:39:38.131966 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.131936    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860458800"
Jul 27 21:39:38.157029 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.156998    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml5zv\" (UniqueName: \"kubernetes.io/projected/7aa19403-d5dd-4dff-868c-3581db6d3094-kube-api-access-ml5zv\") pod \"7aa19403-d5dd-4dff-868c-3581db6d3094\" (UID: \"7aa19403-d5dd-4dff-868c-3581db6d3094\") "
Jul 27 21:39:38.159271 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.159243    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aa19403-d5dd-4dff-868c-3581db6d3094-kube-api-access-ml5zv" (OuterVolumeSpecName: "kube-api-access-ml5zv") pod "7aa19403-d5dd-4dff-868c-3581db6d3094" (UID: "7aa19403-d5dd-4dff-868c-3581db6d3094"). InnerVolumeSpecName "kube-api-access-ml5zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:38.173783 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.173763    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7115-140245860458800_7aa19403-d5dd-4dff-868c-3581db6d3094/test-curl-7115-140245860458800/0.log"
Jul 27 21:39:38.209449 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.209412    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7115-140245860458800"]
Jul 27 21:39:38.215308 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.215281    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7115-140245860458800"]
Jul 27 21:39:38.247325 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.247220    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aa19403-d5dd-4dff-868c-3581db6d3094" path="/var/lib/kubelet/pods/7aa19403-d5dd-4dff-868c-3581db6d3094/volumes"
Jul 27 21:39:38.258356 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.258328    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml5zv\" (UniqueName: \"kubernetes.io/projected/7aa19403-d5dd-4dff-868c-3581db6d3094-kube-api-access-ml5zv\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:39:38.403709 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.403659    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:38.404307 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.404283    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aa19403-d5dd-4dff-868c-3581db6d3094" containerName="test-curl-7115-140245860458800"
Jul 27 21:39:38.404307 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.404307    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aa19403-d5dd-4dff-868c-3581db6d3094" containerName="test-curl-7115-140245860458800"
Jul 27 21:39:38.404472 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.404422    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aa19403-d5dd-4dff-868c-3581db6d3094" containerName="test-curl-7115-140245860458800"
Jul 27 21:39:38.408043 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.408019    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:38.419840 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.419812    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:38.459942 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.459887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc2tl\" (UniqueName: \"kubernetes.io/projected/e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4-kube-api-access-gc2tl\") pod \"test-curl-7115-140245860546576\" (UID: \"e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4\") " pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:38.560905 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.560796    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc2tl\" (UniqueName: \"kubernetes.io/projected/e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4-kube-api-access-gc2tl\") pod \"test-curl-7115-140245860546576\" (UID: \"e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4\") " pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:38.571592 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.571565    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc2tl\" (UniqueName: \"kubernetes.io/projected/e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4-kube-api-access-gc2tl\") pod \"test-curl-7115-140245860546576\" (UID: \"e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4\") " pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:38.717700 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.717662    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:38.879416 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:38.879384    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:38.881588 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:39:38.881558    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6c9ba6e_dc2a_4dd6_abe9_2bd44c25f4b4.slice/crio-327e39c1135cef92bd8111e3ce9b80b355f6b01af88c5332a2936b3f13f4e78b WatchSource:0}: Error finding container 327e39c1135cef92bd8111e3ce9b80b355f6b01af88c5332a2936b3f13f4e78b: Status 404 returned error can't find the container with id 327e39c1135cef92bd8111e3ce9b80b355f6b01af88c5332a2936b3f13f4e78b
Jul 27 21:39:39.000183 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:39.000141    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860546576" event={"ID":"e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4","Type":"ContainerStarted","Data":"327e39c1135cef92bd8111e3ce9b80b355f6b01af88c5332a2936b3f13f4e78b"}
Jul 27 21:39:39.001386 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:39.001364    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860458800"
Jul 27 21:39:39.001516 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:39.001401    2566 scope.go:117] "RemoveContainer" containerID="3d66b2e1dced8a85024bb5a66ca7876376533aa43454c4c21bdc3e98716188e1"
Jul 27 21:39:40.010304 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:40.010275    2566 generic.go:356] "Generic (PLEG): container finished" podID="e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4" containerID="a422a42e6fe1a0f21f4b28d74c934aace6da3acce5920593bfd457ef81733e79" exitCode=0
Jul 27 21:39:40.010789 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:40.010371    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860546576" event={"ID":"e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4","Type":"ContainerDied","Data":"a422a42e6fe1a0f21f4b28d74c934aace6da3acce5920593bfd457ef81733e79"}
Jul 27 21:39:41.164304 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.164278    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:41.187400 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.187370    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc2tl\" (UniqueName: \"kubernetes.io/projected/e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4-kube-api-access-gc2tl\") pod \"e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4\" (UID: \"e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4\") "
Jul 27 21:39:41.189599 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.189570    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4-kube-api-access-gc2tl" (OuterVolumeSpecName: "kube-api-access-gc2tl") pod "e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4" (UID: "e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4"). InnerVolumeSpecName "kube-api-access-gc2tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:41.216461 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.216422    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7115-140245860546576_e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4/test-curl-7115-140245860546576/0.log"
Jul 27 21:39:41.258163 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.258130    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:41.266694 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.266665    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:41.289207 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.289125    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc2tl\" (UniqueName: \"kubernetes.io/projected/e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4-kube-api-access-gc2tl\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:39:41.385327 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.385291    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:41.385708 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.385695    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4" containerName="test-curl-7115-140245860546576"
Jul 27 21:39:41.385764 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.385710    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4" containerName="test-curl-7115-140245860546576"
Jul 27 21:39:41.385806 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.385787    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4" containerName="test-curl-7115-140245860546576"
Jul 27 21:39:41.388834 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.388818    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:41.395912 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.395881    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:41.490590 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.490511    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x42b6\" (UniqueName: \"kubernetes.io/projected/3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7-kube-api-access-x42b6\") pod \"test-curl-7115-140245860546576\" (UID: \"3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7\") " pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:41.592180 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.592069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x42b6\" (UniqueName: \"kubernetes.io/projected/3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7-kube-api-access-x42b6\") pod \"test-curl-7115-140245860546576\" (UID: \"3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7\") " pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:41.601229 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.601195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x42b6\" (UniqueName: \"kubernetes.io/projected/3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7-kube-api-access-x42b6\") pod \"test-curl-7115-140245860546576\" (UID: \"3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7\") " pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:41.701043 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.700999    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:41.855213 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:41.855186    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:41.856896 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:39:41.856871    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cfe803f_13b4_4bd3_b85e_6862e8c3c6f7.slice/crio-10e008ff9329b85616b7334da01dd4bbceb19d99385347ff2b86023763e98d8f WatchSource:0}: Error finding container 10e008ff9329b85616b7334da01dd4bbceb19d99385347ff2b86023763e98d8f: Status 404 returned error can't find the container with id 10e008ff9329b85616b7334da01dd4bbceb19d99385347ff2b86023763e98d8f
Jul 27 21:39:42.025572 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:42.025528    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="327e39c1135cef92bd8111e3ce9b80b355f6b01af88c5332a2936b3f13f4e78b"
Jul 27 21:39:42.025572 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:42.025544    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:42.026808 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:42.026781    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860546576" event={"ID":"3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7","Type":"ContainerStarted","Data":"10e008ff9329b85616b7334da01dd4bbceb19d99385347ff2b86023763e98d8f"}
Jul 27 21:39:42.037714 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:42.037683    2566 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7115-140245860546576" oldPodUID="e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4" podUID="3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7"
Jul 27 21:39:42.256800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:42.256761    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4" path="/var/lib/kubelet/pods/e6c9ba6e-dc2a-4dd6-abe9-2bd44c25f4b4/volumes"
Jul 27 21:39:43.034116 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:43.034081    2566 generic.go:356] "Generic (PLEG): container finished" podID="3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7" containerID="1bdb429849b53c6c8df3a9aa88537ab10f4c9ab487aa9502305da0ba6174cd95" exitCode=0
Jul 27 21:39:43.034328 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:43.034164    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860546576" event={"ID":"3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7","Type":"ContainerDied","Data":"1bdb429849b53c6c8df3a9aa88537ab10f4c9ab487aa9502305da0ba6174cd95"}
Jul 27 21:39:44.179260 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.179225    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:44.199950 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.199910    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7115-140245860546576_3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7/test-curl-7115-140245860546576/0.log"
Jul 27 21:39:44.220947 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.220918    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x42b6\" (UniqueName: \"kubernetes.io/projected/3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7-kube-api-access-x42b6\") pod \"3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7\" (UID: \"3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7\") "
Jul 27 21:39:44.221919 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.221893    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:44.223975 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.223941    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7-kube-api-access-x42b6" (OuterVolumeSpecName: "kube-api-access-x42b6") pod "3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7" (UID: "3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7"). InnerVolumeSpecName "kube-api-access-x42b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:44.225468 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.225446    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7115-140245860546576"]
Jul 27 21:39:44.243669 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.243645    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7" path="/var/lib/kubelet/pods/3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7/volumes"
Jul 27 21:39:44.322469 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.322380    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x42b6\" (UniqueName: \"kubernetes.io/projected/3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7-kube-api-access-x42b6\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:39:44.344326 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.344291    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7115-140245860547584"]
Jul 27 21:39:44.344709 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.344696    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7" containerName="test-curl-7115-140245860546576"
Jul 27 21:39:44.344781 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.344711    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7" containerName="test-curl-7115-140245860546576"
Jul 27 21:39:44.344781 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.344772    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cfe803f-13b4-4bd3-b85e-6862e8c3c6f7" containerName="test-curl-7115-140245860546576"
Jul 27 21:39:44.347866 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.347850    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:44.355659 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.355632    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860547584"]
Jul 27 21:39:44.423586 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.423520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgph9\" (UniqueName: \"kubernetes.io/projected/5549ae16-cb10-40ed-b771-9637ba8a1f5c-kube-api-access-vgph9\") pod \"test-curl-7115-140245860547584\" (UID: \"5549ae16-cb10-40ed-b771-9637ba8a1f5c\") " pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:44.525054 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.525006    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgph9\" (UniqueName: \"kubernetes.io/projected/5549ae16-cb10-40ed-b771-9637ba8a1f5c-kube-api-access-vgph9\") pod \"test-curl-7115-140245860547584\" (UID: \"5549ae16-cb10-40ed-b771-9637ba8a1f5c\") " pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:44.533847 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.533821    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgph9\" (UniqueName: \"kubernetes.io/projected/5549ae16-cb10-40ed-b771-9637ba8a1f5c-kube-api-access-vgph9\") pod \"test-curl-7115-140245860547584\" (UID: \"5549ae16-cb10-40ed-b771-9637ba8a1f5c\") " pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:44.659247 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.659152    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:44.810720 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:44.810692    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7115-140245860547584"]
Jul 27 21:39:44.812690 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:39:44.812650    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5549ae16_cb10_40ed_b771_9637ba8a1f5c.slice/crio-f880e428780cc82d2f3860b9f6e4d7add246e697287cb64add0f6269c0065b11 WatchSource:0}: Error finding container f880e428780cc82d2f3860b9f6e4d7add246e697287cb64add0f6269c0065b11: Status 404 returned error can't find the container with id f880e428780cc82d2f3860b9f6e4d7add246e697287cb64add0f6269c0065b11
Jul 27 21:39:45.045364 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:45.045335    2566 scope.go:117] "RemoveContainer" containerID="1bdb429849b53c6c8df3a9aa88537ab10f4c9ab487aa9502305da0ba6174cd95"
Jul 27 21:39:45.045597 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:45.045333    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860546576"
Jul 27 21:39:45.047389 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:45.047361    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860547584" event={"ID":"5549ae16-cb10-40ed-b771-9637ba8a1f5c","Type":"ContainerStarted","Data":"f880e428780cc82d2f3860b9f6e4d7add246e697287cb64add0f6269c0065b11"}
Jul 27 21:39:46.055228 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:46.055190    2566 generic.go:356] "Generic (PLEG): container finished" podID="5549ae16-cb10-40ed-b771-9637ba8a1f5c" containerID="9bf02bf19289b1cbb61233ac504c68e43c1a27013c51e88fd74bd26355739c01" exitCode=0
Jul 27 21:39:46.055619 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:46.055280    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7115-140245860547584" event={"ID":"5549ae16-cb10-40ed-b771-9637ba8a1f5c","Type":"ContainerDied","Data":"9bf02bf19289b1cbb61233ac504c68e43c1a27013c51e88fd74bd26355739c01"}
Jul 27 21:39:47.232380 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:47.232347    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:47.251986 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:47.251953    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7115-140245860547584_5549ae16-cb10-40ed-b771-9637ba8a1f5c/test-curl-7115-140245860547584/0.log"
Jul 27 21:39:47.273889 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:47.273859    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7115-140245860547584"]
Jul 27 21:39:47.277996 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:47.277971    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7115-140245860547584"]
Jul 27 21:39:47.355644 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:47.355560    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgph9\" (UniqueName: \"kubernetes.io/projected/5549ae16-cb10-40ed-b771-9637ba8a1f5c-kube-api-access-vgph9\") pod \"5549ae16-cb10-40ed-b771-9637ba8a1f5c\" (UID: \"5549ae16-cb10-40ed-b771-9637ba8a1f5c\") "
Jul 27 21:39:47.357693 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:47.357664    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5549ae16-cb10-40ed-b771-9637ba8a1f5c-kube-api-access-vgph9" (OuterVolumeSpecName: "kube-api-access-vgph9") pod "5549ae16-cb10-40ed-b771-9637ba8a1f5c" (UID: "5549ae16-cb10-40ed-b771-9637ba8a1f5c"). InnerVolumeSpecName "kube-api-access-vgph9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:47.456487 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:47.456443    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgph9\" (UniqueName: \"kubernetes.io/projected/5549ae16-cb10-40ed-b771-9637ba8a1f5c-kube-api-access-vgph9\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:39:48.069278 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:48.069245    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:48.069278 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:48.069280    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f880e428780cc82d2f3860b9f6e4d7add246e697287cb64add0f6269c0065b11"
Jul 27 21:39:48.079483 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:39:48.079451    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7115-140245860547584\" is forbidden: User \"system:node:ip-10-0-141-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-50.ec2.internal' and this object" podUID="5549ae16-cb10-40ed-b771-9637ba8a1f5c" pod="opendatahub/test-curl-7115-140245860547584"
Jul 27 21:39:48.244984 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:48.244948    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5549ae16-cb10-40ed-b771-9637ba8a1f5c" path="/var/lib/kubelet/pods/5549ae16-cb10-40ed-b771-9637ba8a1f5c/volumes"
Jul 27 21:39:55.171645 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.171605    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"]
Jul 27 21:39:55.172029 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.171990    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5549ae16-cb10-40ed-b771-9637ba8a1f5c" containerName="test-curl-7115-140245860547584"
Jul 27 21:39:55.172029 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.172000    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5549ae16-cb10-40ed-b771-9637ba8a1f5c" containerName="test-curl-7115-140245860547584"
Jul 27 21:39:55.172099 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.172074    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5549ae16-cb10-40ed-b771-9637ba8a1f5c" containerName="test-curl-7115-140245860547584"
Jul 27 21:39:55.177222 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.177202    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.179946 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.179926    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-5d8041-dockercfg-nzmfh\""
Jul 27 21:39:55.180049 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.179932    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-5d8041\""
Jul 27 21:39:55.185204 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.185174    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"]
Jul 27 21:39:55.336529 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.336483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wv58\" (UniqueName: \"kubernetes.io/projected/5ae602a6-a76d-4d12-a775-ef81eb36b007-kube-api-access-8wv58\") pod \"payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.336761 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.336576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae602a6-a76d-4d12-a775-ef81eb36b007-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.437806 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.437724    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wv58\" (UniqueName: \"kubernetes.io/projected/5ae602a6-a76d-4d12-a775-ef81eb36b007-kube-api-access-8wv58\") pod \"payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.437806 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.437758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae602a6-a76d-4d12-a775-ef81eb36b007-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.438419 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.438400    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae602a6-a76d-4d12-a775-ef81eb36b007-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.446718 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.446690    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wv58\" (UniqueName: \"kubernetes.io/projected/5ae602a6-a76d-4d12-a775-ef81eb36b007-kube-api-access-8wv58\") pod \"payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.490519 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.490476    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:55.631758 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:55.631730    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"]
Jul 27 21:39:55.633769 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:39:55.633737    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae602a6_a76d_4d12_a775_ef81eb36b007.slice/crio-4ebfee1b9c0eb077543ac96689c2a8e006633edb7f411e32787fa1dc53bea811 WatchSource:0}: Error finding container 4ebfee1b9c0eb077543ac96689c2a8e006633edb7f411e32787fa1dc53bea811: Status 404 returned error can't find the container with id 4ebfee1b9c0eb077543ac96689c2a8e006633edb7f411e32787fa1dc53bea811
Jul 27 21:39:56.117651 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:56.117615    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx" event={"ID":"5ae602a6-a76d-4d12-a775-ef81eb36b007","Type":"ContainerStarted","Data":"b72c8b0f74f56dcbb32263c66bd2392c533efae3aaf214dde0b2a333f512e7ea"}
Jul 27 21:39:56.117834 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:56.117698    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx" event={"ID":"5ae602a6-a76d-4d12-a775-ef81eb36b007","Type":"ContainerStarted","Data":"4ebfee1b9c0eb077543ac96689c2a8e006633edb7f411e32787fa1dc53bea811"}
Jul 27 21:39:56.117834 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:56.117737    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:39:56.139995 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:39:56.139936    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx" podStartSLOduration=1.139917391 podStartE2EDuration="1.139917391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:39:56.138148203 +0000 UTC m=+2922.434479534" watchObservedRunningTime="2026-07-27 21:39:56.139917391 +0000 UTC m=+2922.436248706"
Jul 27 21:40:07.126106 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:07.126075    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:40:09.937141 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.937101    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"]
Jul 27 21:40:09.941873 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.941849    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.944693 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.944669    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-0e6399-openshift-default-dockercfg-9h6d8\""
Jul 27 21:40:09.962508 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.962473    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"]
Jul 27 21:40:09.982625 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.982590    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-token\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.982787 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.982635    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-credential-socket\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.982787 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.982763    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-socket\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.982906 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.982831    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xjhl\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-kube-api-access-7xjhl\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.982906 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.982874    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b5061a-55a8-4ed0-8faa-e0879abae181-istiod-ca-cert\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.983017 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.982909    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-certs\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.983017 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.982972    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-envoy\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.983017 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.983006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-data\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:09.983169 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:09.983036    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-podinfo\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.083558 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083487    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-socket\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.083742 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083567    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xjhl\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-kube-api-access-7xjhl\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.083742 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b5061a-55a8-4ed0-8faa-e0879abae181-istiod-ca-cert\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.083742 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083624    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-certs\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.083742 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083664    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-envoy\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.083742 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083689    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-data\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.083742 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083717    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-podinfo\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.084051 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083773    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-token\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.084051 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.083817    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-credential-socket\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.084163 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.084104    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-certs\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.084204 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.084162    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-socket\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.084246 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.084222    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-data\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.084430 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.084406    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b5061a-55a8-4ed0-8faa-e0879abae181-istiod-ca-cert\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.084500 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.084418    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-credential-socket\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.086311 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.086270    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-envoy\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.086521 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.086487    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-podinfo\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.092324 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.092300    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-token\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.092788 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.092764    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xjhl\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-kube-api-access-7xjhl\") pod \"e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") " pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.251911 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.251878    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:10.410724 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:10.410697    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"]
Jul 27 21:40:10.412406 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:40:10.412381    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b5061a_55a8_4ed0_8faa_e0879abae181.slice/crio-fc7bb2c96d2e80ce1b714d07780712e1c8b1ef87d555ebbc11dfab867d5bc772 WatchSource:0}: Error finding container fc7bb2c96d2e80ce1b714d07780712e1c8b1ef87d555ebbc11dfab867d5bc772: Status 404 returned error can't find the container with id fc7bb2c96d2e80ce1b714d07780712e1c8b1ef87d555ebbc11dfab867d5bc772
Jul 27 21:40:11.206021 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:11.205981    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" event={"ID":"a5b5061a-55a8-4ed0-8faa-e0879abae181","Type":"ContainerStarted","Data":"fc7bb2c96d2e80ce1b714d07780712e1c8b1ef87d555ebbc11dfab867d5bc772"}
Jul 27 21:40:13.251199 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:13.251157    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 21:40:13.251506 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:13.251235    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 21:40:13.251506 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:13.251263    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 21:40:14.223219 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:14.223179    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" event={"ID":"a5b5061a-55a8-4ed0-8faa-e0879abae181","Type":"ContainerStarted","Data":"1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863"}
Jul 27 21:40:14.245734 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:14.245683    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" podStartSLOduration=2.4095637979999998 podStartE2EDuration="5.245667253s" totalImagesPullingTime="2.836103455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:14.243674767 +0000 UTC m=+2940.540006085" watchObservedRunningTime="2026-07-27 21:40:14.245667253 +0000 UTC m=+2940.541998570"
Jul 27 21:40:14.252032 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:14.252006    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:14.257117 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:14.257095    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:15.228838 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:15.228805    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:15.229971 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:15.229947    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:17.157578 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.157527    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"]
Jul 27 21:40:17.162693 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.162672    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.166373 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.166338    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0e6399\""
Jul 27 21:40:17.167847 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.167831    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0e6399-dockercfg-kwdxt\""
Jul 27 21:40:17.177527 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.177504    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"]
Jul 27 21:40:17.254338 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.254295    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79qgc\" (UniqueName: \"kubernetes.io/projected/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-kube-api-access-79qgc\") pod \"payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.254504 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.254434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.355986 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.355944    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79qgc\" (UniqueName: \"kubernetes.io/projected/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-kube-api-access-79qgc\") pod \"payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.356185 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.356063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.356803 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.356780    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.364978 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.364953    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79qgc\" (UniqueName: \"kubernetes.io/projected/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-kube-api-access-79qgc\") pod \"payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.474207 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.474096    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:17.833383 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:17.833350    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"]
Jul 27 21:40:17.834826 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:40:17.834797    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fc2bf7_b437_4d4a_b5eb_9cbd2c6b662a.slice/crio-baeea6af5f8387fb3992ad186c7630f46caf66ff2c1833688eb7518f37676ea1 WatchSource:0}: Error finding container baeea6af5f8387fb3992ad186c7630f46caf66ff2c1833688eb7518f37676ea1: Status 404 returned error can't find the container with id baeea6af5f8387fb3992ad186c7630f46caf66ff2c1833688eb7518f37676ea1
Jul 27 21:40:18.248583 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:18.248547    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46" event={"ID":"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a","Type":"ContainerStarted","Data":"c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644"}
Jul 27 21:40:18.248969 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:18.248609    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46" event={"ID":"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a","Type":"ContainerStarted","Data":"baeea6af5f8387fb3992ad186c7630f46caf66ff2c1833688eb7518f37676ea1"}
Jul 27 21:40:18.248969 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:18.248640    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:18.266491 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:18.266440    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46" podStartSLOduration=1.266424004 podStartE2EDuration="1.266424004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:18.26509362 +0000 UTC m=+2944.561424938" watchObservedRunningTime="2026-07-27 21:40:18.266424004 +0000 UTC m=+2944.562755322"
Jul 27 21:40:29.256588 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:29.256524    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:40:31.182272 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.182214    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:45926->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Jul 27 21:40:31.182712 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.182318    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:45926->10.133.0.67:15021: read: connection reset by peer"
Jul 27 21:40:31.327168 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.327136    2566 generic.go:356] "Generic (PLEG): container finished" podID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerID="1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863" exitCode=0
Jul 27 21:40:31.327362 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.327218    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" event={"ID":"a5b5061a-55a8-4ed0-8faa-e0879abae181","Type":"ContainerDied","Data":"1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863"}
Jul 27 21:40:31.327711 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.327697    2566 scope.go:117] "RemoveContainer" containerID="1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863"
Jul 27 21:40:31.328800 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.328770    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 21:40:31.328898 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.328840    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 21:40:31.328898 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:31.328870    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 21:40:32.335672 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:32.335642    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" event={"ID":"a5b5061a-55a8-4ed0-8faa-e0879abae181","Type":"ContainerStarted","Data":"ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4"}
Jul 27 21:40:33.252490 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:33.252449    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:33.252756 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:33.252732    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:40:33.252842 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:33.252794    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:40:34.252304 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:34.252272    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:40:34.252729 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:34.252324    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:40:35.252898 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:35.252819    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:40:35.252898 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:35.252878    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:40:36.252367 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:36.252328    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 21:40:36.252578 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:36.252392    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 21:40:37.256949 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:37.256917    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:37.257393 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:37.257185    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:37.257930 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:37.257913    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:40:37.679243 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:37.679162    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8zrzr_e2c6ae0c-916b-4a64-9085-2c9604df477a/payload-processing/0.log"
Jul 27 21:40:37.802151 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:40:37.802122    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46_d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a/payload-processing/0.log"
Jul 27 21:41:14.434679 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:14.434650    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:41:14.444613 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:14.444586    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:41:35.947559 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:35.947497    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx_5ae602a6-a76d-4d12-a775-ef81eb36b007/payload-processing/0.log"
Jul 27 21:41:36.071960 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:36.071921    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8zrzr_e2c6ae0c-916b-4a64-9085-2c9604df477a/payload-processing/0.log"
Jul 27 21:41:36.205016 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:36.204923    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46_d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a/payload-processing/0.log"
Jul 27 21:41:42.604733 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.604687    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"]
Jul 27 21:41:42.608877 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.608847    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.611935 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.611901    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-ef0509\""
Jul 27 21:41:42.612121 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.612100    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-ef0509-dockercfg-4r42s\""
Jul 27 21:41:42.620155 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.620125    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"]
Jul 27 21:41:42.686433 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.686396    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"]
Jul 27 21:41:42.690083 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.690056    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:42.701036 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.700995    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"]
Jul 27 21:41:42.712290 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.712254    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.712468 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.712382    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gmj8\" (UniqueName: \"kubernetes.io/projected/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-kube-api-access-4gmj8\") pod \"payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.813837 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.813798    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1575c-d191-42a6-a80b-4ab4f2503fd7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:42.814051 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.813857    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.814051 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.813942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv8rp\" (UniqueName: \"kubernetes.io/projected/05e1575c-d191-42a6-a80b-4ab4f2503fd7-kube-api-access-hv8rp\") pod \"payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:42.814177 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.814087    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gmj8\" (UniqueName: \"kubernetes.io/projected/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-kube-api-access-4gmj8\") pod \"payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.814810 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.814786    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.823845 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.823812    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gmj8\" (UniqueName: \"kubernetes.io/projected/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-kube-api-access-4gmj8\") pod \"payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.914919 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.914808    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1575c-d191-42a6-a80b-4ab4f2503fd7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:42.914919 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.914863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv8rp\" (UniqueName: \"kubernetes.io/projected/05e1575c-d191-42a6-a80b-4ab4f2503fd7-kube-api-access-hv8rp\") pod \"payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:42.915668 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.915642    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1575c-d191-42a6-a80b-4ab4f2503fd7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:42.921698 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.921667    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:42.924803 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:42.924773    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv8rp\" (UniqueName: \"kubernetes.io/projected/05e1575c-d191-42a6-a80b-4ab4f2503fd7-kube-api-access-hv8rp\") pod \"payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:43.006930 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.006896    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:43.081106 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.081066    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"]
Jul 27 21:41:43.084842 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:41:43.084616    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3248ad8_24f1_4c01_802a_bfcd076d4fd1.slice/crio-92656033099e0a97536606f03cfd90d178e6a6805746de1f9061cfa922ace3f0 WatchSource:0}: Error finding container 92656033099e0a97536606f03cfd90d178e6a6805746de1f9061cfa922ace3f0: Status 404 returned error can't find the container with id 92656033099e0a97536606f03cfd90d178e6a6805746de1f9061cfa922ace3f0
Jul 27 21:41:43.173368 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.173339    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"]
Jul 27 21:41:43.175615 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:41:43.175582    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e1575c_d191_42a6_a80b_4ab4f2503fd7.slice/crio-cff289087d154f06e635dae8771f1ae223db354bd541f88b9f44ba3e97d7e07d WatchSource:0}: Error finding container cff289087d154f06e635dae8771f1ae223db354bd541f88b9f44ba3e97d7e07d: Status 404 returned error can't find the container with id cff289087d154f06e635dae8771f1ae223db354bd541f88b9f44ba3e97d7e07d
Jul 27 21:41:43.748242 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.748205    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s" event={"ID":"05e1575c-d191-42a6-a80b-4ab4f2503fd7","Type":"ContainerStarted","Data":"225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939"}
Jul 27 21:41:43.748729 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.748274    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:41:43.748729 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.748297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s" event={"ID":"05e1575c-d191-42a6-a80b-4ab4f2503fd7","Type":"ContainerStarted","Data":"cff289087d154f06e635dae8771f1ae223db354bd541f88b9f44ba3e97d7e07d"}
Jul 27 21:41:43.749791 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.749763    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr" event={"ID":"a3248ad8-24f1-4c01-802a-bfcd076d4fd1","Type":"ContainerStarted","Data":"fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1"}
Jul 27 21:41:43.749926 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.749809    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr" event={"ID":"a3248ad8-24f1-4c01-802a-bfcd076d4fd1","Type":"ContainerStarted","Data":"92656033099e0a97536606f03cfd90d178e6a6805746de1f9061cfa922ace3f0"}
Jul 27 21:41:43.749926 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.749895    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:43.769808 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.769752    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s" podStartSLOduration=1.7697318659999999 podStartE2EDuration="1.769731866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:43.767299433 +0000 UTC m=+3030.063630751" watchObservedRunningTime="2026-07-27 21:41:43.769731866 +0000 UTC m=+3030.066063184"
Jul 27 21:41:43.788471 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:43.788413    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr" podStartSLOduration=1.7883971459999999 podStartE2EDuration="1.788397146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:43.786455388 +0000 UTC m=+3030.082786706" watchObservedRunningTime="2026-07-27 21:41:43.788397146 +0000 UTC m=+3030.084728465"
Jul 27 21:41:54.759215 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:54.759183    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:41:54.759618 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:41:54.759262    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:42:00.366830 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.366794    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"]
Jul 27 21:42:00.370405 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.370387    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"
Jul 27 21:42:00.373812 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.373778    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:42:00.382765 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.382739    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"]
Jul 27 21:42:00.404729 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.404677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a2f5b4-830f-4ad6-9cf6-11e0684cb80e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv\" (UID: \"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"
Jul 27 21:42:00.505837 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.505789    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a2f5b4-830f-4ad6-9cf6-11e0684cb80e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv\" (UID: \"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"
Jul 27 21:42:00.506466 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.506447    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a2f5b4-830f-4ad6-9cf6-11e0684cb80e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv\" (UID: \"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"
Jul 27 21:42:00.683294 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.683198    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"
Jul 27 21:42:00.845736 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.845710    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"]
Jul 27 21:42:00.847980 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:42:00.847952    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a2f5b4_830f_4ad6_9cf6_11e0684cb80e.slice/crio-b9bae963607bb98e8ab30cafbf5f420af068e34297458a51e2532a12d0f7271a WatchSource:0}: Error finding container b9bae963607bb98e8ab30cafbf5f420af068e34297458a51e2532a12d0f7271a: Status 404 returned error can't find the container with id b9bae963607bb98e8ab30cafbf5f420af068e34297458a51e2532a12d0f7271a
Jul 27 21:42:00.859884 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:00.859856    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv" event={"ID":"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e","Type":"ContainerStarted","Data":"b9bae963607bb98e8ab30cafbf5f420af068e34297458a51e2532a12d0f7271a"}
Jul 27 21:42:01.867248 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:01.867158    2566 generic.go:356] "Generic (PLEG): container finished" podID="77a2f5b4-830f-4ad6-9cf6-11e0684cb80e" containerID="d06115adb3968ecff1ab5aa408f3147aa62fdd38b51fcbab944e9b138a56a36e" exitCode=0
Jul 27 21:42:01.867638 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:01.867250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv" event={"ID":"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e","Type":"ContainerDied","Data":"d06115adb3968ecff1ab5aa408f3147aa62fdd38b51fcbab944e9b138a56a36e"}
Jul 27 21:42:03.024171 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:03.024139    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"
Jul 27 21:42:03.026113 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:03.026090    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a2f5b4-830f-4ad6-9cf6-11e0684cb80e-maas-api-service-ca\") pod \"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e\" (UID: \"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e\") "
Jul 27 21:42:03.026415 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:03.026392    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a2f5b4-830f-4ad6-9cf6-11e0684cb80e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77a2f5b4-830f-4ad6-9cf6-11e0684cb80e" (UID: "77a2f5b4-830f-4ad6-9cf6-11e0684cb80e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:03.127667 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:03.127579    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77a2f5b4-830f-4ad6-9cf6-11e0684cb80e-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:03.879920 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:03.879888    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"
Jul 27 21:42:03.879920 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:03.879914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv" event={"ID":"77a2f5b4-830f-4ad6-9cf6-11e0684cb80e","Type":"ContainerDied","Data":"b9bae963607bb98e8ab30cafbf5f420af068e34297458a51e2532a12d0f7271a"}
Jul 27 21:42:03.880143 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:03.879962    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9bae963607bb98e8ab30cafbf5f420af068e34297458a51e2532a12d0f7271a"
Jul 27 21:42:13.275473 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.275435    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"]
Jul 27 21:42:13.276114 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.275706    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s" podUID="05e1575c-d191-42a6-a80b-4ab4f2503fd7" containerName="payload-processing" containerID="cri-o://225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939" gracePeriod=30
Jul 27 21:42:13.285892 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.285857    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"]
Jul 27 21:42:13.286150 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.286103    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr" podUID="a3248ad8-24f1-4c01-802a-bfcd076d4fd1" containerName="payload-pre-processing" containerID="cri-o://fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1" gracePeriod=30
Jul 27 21:42:13.588981 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.588953    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:42:13.591981 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.591956    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:42:13.632120 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.632089    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv8rp\" (UniqueName: \"kubernetes.io/projected/05e1575c-d191-42a6-a80b-4ab4f2503fd7-kube-api-access-hv8rp\") pod \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") "
Jul 27 21:42:13.632315 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.632149    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1575c-d191-42a6-a80b-4ab4f2503fd7-plugins-config-volume\") pod \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\" (UID: \"05e1575c-d191-42a6-a80b-4ab4f2503fd7\") "
Jul 27 21:42:13.632315 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.632280    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gmj8\" (UniqueName: \"kubernetes.io/projected/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-kube-api-access-4gmj8\") pod \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") "
Jul 27 21:42:13.632437 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.632321    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-plugins-config-volume\") pod \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\" (UID: \"a3248ad8-24f1-4c01-802a-bfcd076d4fd1\") "
Jul 27 21:42:13.632701 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.632668    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e1575c-d191-42a6-a80b-4ab4f2503fd7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05e1575c-d191-42a6-a80b-4ab4f2503fd7" (UID: "05e1575c-d191-42a6-a80b-4ab4f2503fd7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:13.632821 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.632793    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3248ad8-24f1-4c01-802a-bfcd076d4fd1" (UID: "a3248ad8-24f1-4c01-802a-bfcd076d4fd1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:13.634475 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.634452    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e1575c-d191-42a6-a80b-4ab4f2503fd7-kube-api-access-hv8rp" (OuterVolumeSpecName: "kube-api-access-hv8rp") pod "05e1575c-d191-42a6-a80b-4ab4f2503fd7" (UID: "05e1575c-d191-42a6-a80b-4ab4f2503fd7"). InnerVolumeSpecName "kube-api-access-hv8rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:13.634590 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.634566    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-kube-api-access-4gmj8" (OuterVolumeSpecName: "kube-api-access-4gmj8") pod "a3248ad8-24f1-4c01-802a-bfcd076d4fd1" (UID: "a3248ad8-24f1-4c01-802a-bfcd076d4fd1"). InnerVolumeSpecName "kube-api-access-4gmj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:13.733221 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.733177    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gmj8\" (UniqueName: \"kubernetes.io/projected/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-kube-api-access-4gmj8\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:13.733221 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.733212    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3248ad8-24f1-4c01-802a-bfcd076d4fd1-plugins-config-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:13.733221 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.733225    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv8rp\" (UniqueName: \"kubernetes.io/projected/05e1575c-d191-42a6-a80b-4ab4f2503fd7-kube-api-access-hv8rp\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:13.733461 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.733234    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e1575c-d191-42a6-a80b-4ab4f2503fd7-plugins-config-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:13.938987 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.938891    2566 generic.go:356] "Generic (PLEG): container finished" podID="a3248ad8-24f1-4c01-802a-bfcd076d4fd1" containerID="fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1" exitCode=0
Jul 27 21:42:13.938987 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.938944    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"
Jul 27 21:42:13.939217 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.938977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr" event={"ID":"a3248ad8-24f1-4c01-802a-bfcd076d4fd1","Type":"ContainerDied","Data":"fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1"}
Jul 27 21:42:13.939217 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.939040    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr" event={"ID":"a3248ad8-24f1-4c01-802a-bfcd076d4fd1","Type":"ContainerDied","Data":"92656033099e0a97536606f03cfd90d178e6a6805746de1f9061cfa922ace3f0"}
Jul 27 21:42:13.939217 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.939063    2566 scope.go:117] "RemoveContainer" containerID="fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1"
Jul 27 21:42:13.940497 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.940473    2566 generic.go:356] "Generic (PLEG): container finished" podID="05e1575c-d191-42a6-a80b-4ab4f2503fd7" containerID="225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939" exitCode=0
Jul 27 21:42:13.940634 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.940513    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"
Jul 27 21:42:13.940634 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.940575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s" event={"ID":"05e1575c-d191-42a6-a80b-4ab4f2503fd7","Type":"ContainerDied","Data":"225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939"}
Jul 27 21:42:13.940732 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.940642    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s" event={"ID":"05e1575c-d191-42a6-a80b-4ab4f2503fd7","Type":"ContainerDied","Data":"cff289087d154f06e635dae8771f1ae223db354bd541f88b9f44ba3e97d7e07d"}
Jul 27 21:42:13.949425 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.949405    2566 scope.go:117] "RemoveContainer" containerID="fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1"
Jul 27 21:42:13.949782 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:42:13.949765    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1\": container with ID starting with fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1 not found: ID does not exist" containerID="fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1"
Jul 27 21:42:13.949837 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.949795    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1"} err="failed to get container status \"fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1\": rpc error: code = NotFound desc = could not find container \"fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1\": container with ID starting with fd96b16554fb9937ce7223d496d895a61a84bb6105d1f4907a3f3628c1add3f1 not found: ID does not exist"
Jul 27 21:42:13.949837 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.949823    2566 scope.go:117] "RemoveContainer" containerID="225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939"
Jul 27 21:42:13.959294 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.959271    2566 scope.go:117] "RemoveContainer" containerID="225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939"
Jul 27 21:42:13.959655 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:42:13.959626    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939\": container with ID starting with 225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939 not found: ID does not exist" containerID="225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939"
Jul 27 21:42:13.959825 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.959660    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939"} err="failed to get container status \"225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939\": rpc error: code = NotFound desc = could not find container \"225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939\": container with ID starting with 225bdd9347b2c200905db5aa3815e2394d227056a425ee55b291b2c687568939 not found: ID does not exist"
Jul 27 21:42:13.963228 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.963192    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"]
Jul 27 21:42:13.965603 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.965581    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ef0509-6f488c6dd4-zpnwr"]
Jul 27 21:42:13.975589 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.975551    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"]
Jul 27 21:42:13.979070 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:13.979043    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ef0509-6df4cf649d-rqc2s"]
Jul 27 21:42:14.244318 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:14.244285    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e1575c-d191-42a6-a80b-4ab4f2503fd7" path="/var/lib/kubelet/pods/05e1575c-d191-42a6-a80b-4ab4f2503fd7/volumes"
Jul 27 21:42:14.244680 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:14.244667    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3248ad8-24f1-4c01-802a-bfcd076d4fd1" path="/var/lib/kubelet/pods/a3248ad8-24f1-4c01-802a-bfcd076d4fd1/volumes"
Jul 27 21:42:15.438820 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:15.438781    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"]
Jul 27 21:42:15.442392 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:15.442355    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ef0509-42kcv"]
Jul 27 21:42:16.244232 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:16.244191    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a2f5b4-830f-4ad6-9cf6-11e0684cb80e" path="/var/lib/kubelet/pods/77a2f5b4-830f-4ad6-9cf6-11e0684cb80e/volumes"
Jul 27 21:42:19.775954 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.775919    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5jggk"]
Jul 27 21:42:19.776401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776344    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e1575c-d191-42a6-a80b-4ab4f2503fd7" containerName="payload-processing"
Jul 27 21:42:19.776401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776356    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e1575c-d191-42a6-a80b-4ab4f2503fd7" containerName="payload-processing"
Jul 27 21:42:19.776401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776366    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a2f5b4-830f-4ad6-9cf6-11e0684cb80e" containerName="revoke-keys"
Jul 27 21:42:19.776401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776372    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a2f5b4-830f-4ad6-9cf6-11e0684cb80e" containerName="revoke-keys"
Jul 27 21:42:19.776401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776387    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3248ad8-24f1-4c01-802a-bfcd076d4fd1" containerName="payload-pre-processing"
Jul 27 21:42:19.776401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776393    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3248ad8-24f1-4c01-802a-bfcd076d4fd1" containerName="payload-pre-processing"
Jul 27 21:42:19.776644 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776450    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3248ad8-24f1-4c01-802a-bfcd076d4fd1" containerName="payload-pre-processing"
Jul 27 21:42:19.776644 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776461    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a2f5b4-830f-4ad6-9cf6-11e0684cb80e" containerName="revoke-keys"
Jul 27 21:42:19.776644 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.776467    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e1575c-d191-42a6-a80b-4ab4f2503fd7" containerName="payload-processing"
Jul 27 21:42:19.781353 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.781333    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:19.784837 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.784815    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-t6tqz\""
Jul 27 21:42:19.786467 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.786442    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5jggk"]
Jul 27 21:42:19.891893 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.891857    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw5vb\" (UniqueName: \"kubernetes.io/projected/6f6e643d-8af0-49c4-ae63-830e280e0d95-kube-api-access-xw5vb\") pod \"kuadrant-operator-catalog-5jggk\" (UID: \"6f6e643d-8af0-49c4-ae63-830e280e0d95\") " pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:19.993236 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:19.993179    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw5vb\" (UniqueName: \"kubernetes.io/projected/6f6e643d-8af0-49c4-ae63-830e280e0d95-kube-api-access-xw5vb\") pod \"kuadrant-operator-catalog-5jggk\" (UID: \"6f6e643d-8af0-49c4-ae63-830e280e0d95\") " pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:20.001863 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:20.001836    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw5vb\" (UniqueName: \"kubernetes.io/projected/6f6e643d-8af0-49c4-ae63-830e280e0d95-kube-api-access-xw5vb\") pod \"kuadrant-operator-catalog-5jggk\" (UID: \"6f6e643d-8af0-49c4-ae63-830e280e0d95\") " pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:20.092367 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:20.092277    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:20.245612 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:42:20.245577    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6e643d_8af0_49c4_ae63_830e280e0d95.slice/crio-90764ea79950b9d65c77b60e5ad0faf71f79c10d16af1a0de6de1fba2e9737b5 WatchSource:0}: Error finding container 90764ea79950b9d65c77b60e5ad0faf71f79c10d16af1a0de6de1fba2e9737b5: Status 404 returned error can't find the container with id 90764ea79950b9d65c77b60e5ad0faf71f79c10d16af1a0de6de1fba2e9737b5
Jul 27 21:42:20.246254 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:20.246229    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5jggk"]
Jul 27 21:42:20.986148 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:20.986106    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5jggk" event={"ID":"6f6e643d-8af0-49c4-ae63-830e280e0d95","Type":"ContainerStarted","Data":"90764ea79950b9d65c77b60e5ad0faf71f79c10d16af1a0de6de1fba2e9737b5"}
Jul 27 21:42:21.993952 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:21.993911    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5jggk" event={"ID":"6f6e643d-8af0-49c4-ae63-830e280e0d95","Type":"ContainerStarted","Data":"13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7"}
Jul 27 21:42:22.018669 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:22.018604    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5jggk" podStartSLOduration=1.538683202 podStartE2EDuration="3.01858507s" totalImagesPullingTime="1.479901868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:22.01618765 +0000 UTC m=+3068.312518981" watchObservedRunningTime="2026-07-27 21:42:22.01858507 +0000 UTC m=+3068.314916387"
Jul 27 21:42:25.798227 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:25.798179    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"]
Jul 27 21:42:25.801965 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:25.801940    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"
Jul 27 21:42:25.804933 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:25.804906    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:42:25.812483 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:25.812455    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"]
Jul 27 21:42:25.958564 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:25.958502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a96211d-e365-47c7-ae55-1fb5ce30f534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2\" (UID: \"4a96211d-e365-47c7-ae55-1fb5ce30f534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"
Jul 27 21:42:26.060182 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:26.060072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a96211d-e365-47c7-ae55-1fb5ce30f534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2\" (UID: \"4a96211d-e365-47c7-ae55-1fb5ce30f534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"
Jul 27 21:42:26.060826 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:26.060799    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a96211d-e365-47c7-ae55-1fb5ce30f534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2\" (UID: \"4a96211d-e365-47c7-ae55-1fb5ce30f534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"
Jul 27 21:42:26.114946 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:26.114906    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"
Jul 27 21:42:26.263771 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:26.263742    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"]
Jul 27 21:42:26.266218 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:42:26.266174    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a96211d_e365_47c7_ae55_1fb5ce30f534.slice/crio-3cf404cba8ebeebafda9f26312dbcfc15585832184c5524e0a40618d9f590ce3 WatchSource:0}: Error finding container 3cf404cba8ebeebafda9f26312dbcfc15585832184c5524e0a40618d9f590ce3: Status 404 returned error can't find the container with id 3cf404cba8ebeebafda9f26312dbcfc15585832184c5524e0a40618d9f590ce3
Jul 27 21:42:27.024078 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:27.024028    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2" event={"ID":"4a96211d-e365-47c7-ae55-1fb5ce30f534","Type":"ContainerStarted","Data":"76f066c2ae69b536bc96accbb6db6abfdd60dbcaaf73fa1f8474ad2bbaa31e77"}
Jul 27 21:42:27.024510 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:27.024097    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2" event={"ID":"4a96211d-e365-47c7-ae55-1fb5ce30f534","Type":"ContainerStarted","Data":"3cf404cba8ebeebafda9f26312dbcfc15585832184c5524e0a40618d9f590ce3"}
Jul 27 21:42:27.039516 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:27.039455    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2" podStartSLOduration=2.039432776 podStartE2EDuration="2.039432776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:42:27.038132029 +0000 UTC m=+3073.334463347" watchObservedRunningTime="2026-07-27 21:42:27.039432776 +0000 UTC m=+3073.335764094"
Jul 27 21:42:28.031230 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:28.031187    2566 generic.go:356] "Generic (PLEG): container finished" podID="4a96211d-e365-47c7-ae55-1fb5ce30f534" containerID="76f066c2ae69b536bc96accbb6db6abfdd60dbcaaf73fa1f8474ad2bbaa31e77" exitCode=0
Jul 27 21:42:28.031650 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:28.031275    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2" event={"ID":"4a96211d-e365-47c7-ae55-1fb5ce30f534","Type":"ContainerDied","Data":"76f066c2ae69b536bc96accbb6db6abfdd60dbcaaf73fa1f8474ad2bbaa31e77"}
Jul 27 21:42:29.184999 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:29.184972    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"
Jul 27 21:42:29.293302 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:29.293155    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a96211d-e365-47c7-ae55-1fb5ce30f534-maas-api-service-ca\") pod \"4a96211d-e365-47c7-ae55-1fb5ce30f534\" (UID: \"4a96211d-e365-47c7-ae55-1fb5ce30f534\") "
Jul 27 21:42:29.293555 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:29.293509    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a96211d-e365-47c7-ae55-1fb5ce30f534-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a96211d-e365-47c7-ae55-1fb5ce30f534" (UID: "4a96211d-e365-47c7-ae55-1fb5ce30f534"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:29.394960 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:29.394912    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a96211d-e365-47c7-ae55-1fb5ce30f534-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:30.044112 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:30.044085    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"
Jul 27 21:42:30.044291 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:30.044112    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2" event={"ID":"4a96211d-e365-47c7-ae55-1fb5ce30f534","Type":"ContainerDied","Data":"3cf404cba8ebeebafda9f26312dbcfc15585832184c5524e0a40618d9f590ce3"}
Jul 27 21:42:30.044291 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:30.044155    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cf404cba8ebeebafda9f26312dbcfc15585832184c5524e0a40618d9f590ce3"
Jul 27 21:42:30.093290 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:30.093250    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:30.093480 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:30.093352    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:30.117384 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:30.117358    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:31.073456 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:31.073426    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:31.124717 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:31.124679    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5jggk"]
Jul 27 21:42:33.062123 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:33.062080    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5jggk" podUID="6f6e643d-8af0-49c4-ae63-830e280e0d95" containerName="registry-server" containerID="cri-o://13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7" gracePeriod=2
Jul 27 21:42:33.331327 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:33.331294    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:33.437607 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:33.437528    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw5vb\" (UniqueName: \"kubernetes.io/projected/6f6e643d-8af0-49c4-ae63-830e280e0d95-kube-api-access-xw5vb\") pod \"6f6e643d-8af0-49c4-ae63-830e280e0d95\" (UID: \"6f6e643d-8af0-49c4-ae63-830e280e0d95\") "
Jul 27 21:42:33.439720 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:33.439700    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6e643d-8af0-49c4-ae63-830e280e0d95-kube-api-access-xw5vb" (OuterVolumeSpecName: "kube-api-access-xw5vb") pod "6f6e643d-8af0-49c4-ae63-830e280e0d95" (UID: "6f6e643d-8af0-49c4-ae63-830e280e0d95"). InnerVolumeSpecName "kube-api-access-xw5vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:33.538435 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:33.538391    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw5vb\" (UniqueName: \"kubernetes.io/projected/6f6e643d-8af0-49c4-ae63-830e280e0d95-kube-api-access-xw5vb\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:34.068455 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.068418    2566 generic.go:356] "Generic (PLEG): container finished" podID="6f6e643d-8af0-49c4-ae63-830e280e0d95" containerID="13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7" exitCode=0
Jul 27 21:42:34.068928 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.068468    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5jggk"
Jul 27 21:42:34.068928 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.068498    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5jggk" event={"ID":"6f6e643d-8af0-49c4-ae63-830e280e0d95","Type":"ContainerDied","Data":"13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7"}
Jul 27 21:42:34.068928 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.068572    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5jggk" event={"ID":"6f6e643d-8af0-49c4-ae63-830e280e0d95","Type":"ContainerDied","Data":"90764ea79950b9d65c77b60e5ad0faf71f79c10d16af1a0de6de1fba2e9737b5"}
Jul 27 21:42:34.068928 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.068593    2566 scope.go:117] "RemoveContainer" containerID="13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7"
Jul 27 21:42:34.078930 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.078903    2566 scope.go:117] "RemoveContainer" containerID="13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7"
Jul 27 21:42:34.079258 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:42:34.079239    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7\": container with ID starting with 13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7 not found: ID does not exist" containerID="13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7"
Jul 27 21:42:34.079311 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.079271    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7"} err="failed to get container status \"13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7\": rpc error: code = NotFound desc = could not find container \"13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7\": container with ID starting with 13945ec17ffe4c1f6bd81bcdf9df3bb1a057899ef98e859f4b273168f7b8e0b7 not found: ID does not exist"
Jul 27 21:42:34.092242 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.092208    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5jggk"]
Jul 27 21:42:34.094444 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.094422    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5jggk"]
Jul 27 21:42:34.243481 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:34.243452    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6e643d-8af0-49c4-ae63-830e280e0d95" path="/var/lib/kubelet/pods/6f6e643d-8af0-49c4-ae63-830e280e0d95/volumes"
Jul 27 21:42:42.863487 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:42.863445    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"]
Jul 27 21:42:42.864090 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:42.863845    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx" podUID="5ae602a6-a76d-4d12-a775-ef81eb36b007" containerName="payload-processing" containerID="cri-o://b72c8b0f74f56dcbb32263c66bd2392c533efae3aaf214dde0b2a333f512e7ea" gracePeriod=30
Jul 27 21:42:43.128019 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.127990    2566 generic.go:356] "Generic (PLEG): container finished" podID="5ae602a6-a76d-4d12-a775-ef81eb36b007" containerID="b72c8b0f74f56dcbb32263c66bd2392c533efae3aaf214dde0b2a333f512e7ea" exitCode=0
Jul 27 21:42:43.128172 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.128062    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx" event={"ID":"5ae602a6-a76d-4d12-a775-ef81eb36b007","Type":"ContainerDied","Data":"b72c8b0f74f56dcbb32263c66bd2392c533efae3aaf214dde0b2a333f512e7ea"}
Jul 27 21:42:43.149566 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.149505    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:42:43.229267 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.229234    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae602a6-a76d-4d12-a775-ef81eb36b007-plugins-config-volume\") pod \"5ae602a6-a76d-4d12-a775-ef81eb36b007\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") "
Jul 27 21:42:43.229446 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.229297    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wv58\" (UniqueName: \"kubernetes.io/projected/5ae602a6-a76d-4d12-a775-ef81eb36b007-kube-api-access-8wv58\") pod \"5ae602a6-a76d-4d12-a775-ef81eb36b007\" (UID: \"5ae602a6-a76d-4d12-a775-ef81eb36b007\") "
Jul 27 21:42:43.229708 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.229674    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ae602a6-a76d-4d12-a775-ef81eb36b007-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ae602a6-a76d-4d12-a775-ef81eb36b007" (UID: "5ae602a6-a76d-4d12-a775-ef81eb36b007"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:42:43.231809 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.231778    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae602a6-a76d-4d12-a775-ef81eb36b007-kube-api-access-8wv58" (OuterVolumeSpecName: "kube-api-access-8wv58") pod "5ae602a6-a76d-4d12-a775-ef81eb36b007" (UID: "5ae602a6-a76d-4d12-a775-ef81eb36b007"). InnerVolumeSpecName "kube-api-access-8wv58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:42:43.330876 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.330833    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae602a6-a76d-4d12-a775-ef81eb36b007-plugins-config-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:43.330876 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:43.330874    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wv58\" (UniqueName: \"kubernetes.io/projected/5ae602a6-a76d-4d12-a775-ef81eb36b007-kube-api-access-8wv58\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:42:44.136104 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:44.136072    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"
Jul 27 21:42:44.136517 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:44.136114    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx" event={"ID":"5ae602a6-a76d-4d12-a775-ef81eb36b007","Type":"ContainerDied","Data":"4ebfee1b9c0eb077543ac96689c2a8e006633edb7f411e32787fa1dc53bea811"}
Jul 27 21:42:44.136517 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:44.136179    2566 scope.go:117] "RemoveContainer" containerID="b72c8b0f74f56dcbb32263c66bd2392c533efae3aaf214dde0b2a333f512e7ea"
Jul 27 21:42:44.158726 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:44.158679    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"]
Jul 27 21:42:44.165027 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:44.164997    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-5d8041-6466c4c46-g7mxx"]
Jul 27 21:42:44.243815 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:44.243773    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae602a6-a76d-4d12-a775-ef81eb36b007" path="/var/lib/kubelet/pods/5ae602a6-a76d-4d12-a775-ef81eb36b007/volumes"
Jul 27 21:42:45.892007 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:45.891964    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"]
Jul 27 21:42:45.896632 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:45.896599    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-5d8041-kgnp2"]
Jul 27 21:42:46.244212 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:42:46.244178    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a96211d-e365-47c7-ae55-1fb5ce30f534" path="/var/lib/kubelet/pods/4a96211d-e365-47c7-ae55-1fb5ce30f534/volumes"
Jul 27 21:43:36.067401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067313    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"]
Jul 27 21:43:36.067857 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067777    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae602a6-a76d-4d12-a775-ef81eb36b007" containerName="payload-processing"
Jul 27 21:43:36.067857 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067791    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae602a6-a76d-4d12-a775-ef81eb36b007" containerName="payload-processing"
Jul 27 21:43:36.067857 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067812    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a96211d-e365-47c7-ae55-1fb5ce30f534" containerName="revoke-keys"
Jul 27 21:43:36.067857 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067819    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a96211d-e365-47c7-ae55-1fb5ce30f534" containerName="revoke-keys"
Jul 27 21:43:36.067857 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067836    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6e643d-8af0-49c4-ae63-830e280e0d95" containerName="registry-server"
Jul 27 21:43:36.067857 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067841    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6e643d-8af0-49c4-ae63-830e280e0d95" containerName="registry-server"
Jul 27 21:43:36.068049 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067900    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6e643d-8af0-49c4-ae63-830e280e0d95" containerName="registry-server"
Jul 27 21:43:36.068049 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067910    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a96211d-e365-47c7-ae55-1fb5ce30f534" containerName="revoke-keys"
Jul 27 21:43:36.068049 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.067917    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae602a6-a76d-4d12-a775-ef81eb36b007" containerName="payload-processing"
Jul 27 21:43:36.071255 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.071228    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"
Jul 27 21:43:36.073774 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.073747    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:43:36.080993 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.080960    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"]
Jul 27 21:43:36.168143 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.168100    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97df3de4-1663-4aa5-b853-c0e0e59c93e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb\" (UID: \"97df3de4-1663-4aa5-b853-c0e0e59c93e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"
Jul 27 21:43:36.268812 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.268770    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97df3de4-1663-4aa5-b853-c0e0e59c93e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb\" (UID: \"97df3de4-1663-4aa5-b853-c0e0e59c93e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"
Jul 27 21:43:36.269466 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.269446    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97df3de4-1663-4aa5-b853-c0e0e59c93e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb\" (UID: \"97df3de4-1663-4aa5-b853-c0e0e59c93e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"
Jul 27 21:43:36.385801 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.385706    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"
Jul 27 21:43:36.539723 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:36.539693    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"]
Jul 27 21:43:37.456013 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:37.455977    2566 generic.go:356] "Generic (PLEG): container finished" podID="97df3de4-1663-4aa5-b853-c0e0e59c93e6" containerID="50e1dd82d8d1debd24e7b6f71e3788e3ede986d86393608a1901fb2bbd33a5b6" exitCode=0
Jul 27 21:43:37.456446 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:37.456073    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb" event={"ID":"97df3de4-1663-4aa5-b853-c0e0e59c93e6","Type":"ContainerDied","Data":"50e1dd82d8d1debd24e7b6f71e3788e3ede986d86393608a1901fb2bbd33a5b6"}
Jul 27 21:43:37.456446 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:37.456136    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb" event={"ID":"97df3de4-1663-4aa5-b853-c0e0e59c93e6","Type":"ContainerStarted","Data":"38cf4385ddd44f77525949952f28a0a10d68f77d4939807bce0ad222ea613c0f"}
Jul 27 21:43:38.603911 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:38.603885    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"
Jul 27 21:43:38.692324 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:38.692283    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97df3de4-1663-4aa5-b853-c0e0e59c93e6-maas-api-service-ca\") pod \"97df3de4-1663-4aa5-b853-c0e0e59c93e6\" (UID: \"97df3de4-1663-4aa5-b853-c0e0e59c93e6\") "
Jul 27 21:43:38.692775 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:38.692753    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97df3de4-1663-4aa5-b853-c0e0e59c93e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97df3de4-1663-4aa5-b853-c0e0e59c93e6" (UID: "97df3de4-1663-4aa5-b853-c0e0e59c93e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:43:38.793676 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:38.793638    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97df3de4-1663-4aa5-b853-c0e0e59c93e6-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:43:39.469150 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:39.469110    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb" event={"ID":"97df3de4-1663-4aa5-b853-c0e0e59c93e6","Type":"ContainerDied","Data":"38cf4385ddd44f77525949952f28a0a10d68f77d4939807bce0ad222ea613c0f"}
Jul 27 21:43:39.469150 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:39.469144    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"
Jul 27 21:43:39.469150 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:39.469157    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38cf4385ddd44f77525949952f28a0a10d68f77d4939807bce0ad222ea613c0f"
Jul 27 21:43:46.184955 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.184916    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"]
Jul 27 21:43:46.185599 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.185175    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46" podUID="d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" containerName="payload-processing" containerID="cri-o://c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644" gracePeriod=30
Jul 27 21:43:46.466468 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.466442    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:43:46.508588 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.508508    2566 generic.go:356] "Generic (PLEG): container finished" podID="d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" containerID="c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644" exitCode=0
Jul 27 21:43:46.508588 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.508578    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"
Jul 27 21:43:46.508809 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.508582    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46" event={"ID":"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a","Type":"ContainerDied","Data":"c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644"}
Jul 27 21:43:46.508809 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.508707    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46" event={"ID":"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a","Type":"ContainerDied","Data":"baeea6af5f8387fb3992ad186c7630f46caf66ff2c1833688eb7518f37676ea1"}
Jul 27 21:43:46.508809 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.508737    2566 scope.go:117] "RemoveContainer" containerID="c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644"
Jul 27 21:43:46.519864 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.519842    2566 scope.go:117] "RemoveContainer" containerID="c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644"
Jul 27 21:43:46.520187 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:43:46.520166    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644\": container with ID starting with c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644 not found: ID does not exist" containerID="c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644"
Jul 27 21:43:46.520243 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.520202    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644"} err="failed to get container status \"c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644\": rpc error: code = NotFound desc = could not find container \"c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644\": container with ID starting with c3fd6c9699b5f9264356bb4ab0ca07092be623d6ae407e732dcad4ab199c6644 not found: ID does not exist"
Jul 27 21:43:46.576730 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.576694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79qgc\" (UniqueName: \"kubernetes.io/projected/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-kube-api-access-79qgc\") pod \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") "
Jul 27 21:43:46.576911 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.576743    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-plugins-config-volume\") pod \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\" (UID: \"d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a\") "
Jul 27 21:43:46.577142 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.577112    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" (UID: "d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:43:46.579002 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.578978    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-kube-api-access-79qgc" (OuterVolumeSpecName: "kube-api-access-79qgc") pod "d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" (UID: "d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a"). InnerVolumeSpecName "kube-api-access-79qgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:43:46.678151 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.678115    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79qgc\" (UniqueName: \"kubernetes.io/projected/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-kube-api-access-79qgc\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:43:46.678151 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.678146    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a-plugins-config-volume\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:43:46.835594 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.835556    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"]
Jul 27 21:43:46.838181 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:46.838156    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0e6399-597987db88-mcx46"]
Jul 27 21:43:48.243850 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:48.243810    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" path="/var/lib/kubelet/pods/d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a/volumes"
Jul 27 21:43:51.281610 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:51.281572    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"]
Jul 27 21:43:51.284618 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:51.284588    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0e6399-x7cbb"]
Jul 27 21:43:52.243097 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:52.243061    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97df3de4-1663-4aa5-b853-c0e0e59c93e6" path="/var/lib/kubelet/pods/97df3de4-1663-4aa5-b853-c0e0e59c93e6/volumes"
Jul 27 21:43:58.079087 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.079047    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"]
Jul 27 21:43:58.079515 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.079341    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy" containerID="cri-o://ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4" gracePeriod=30
Jul 27 21:43:58.445223 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.445129    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"]
Jul 27 21:43:58.445611 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.445595    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97df3de4-1663-4aa5-b853-c0e0e59c93e6" containerName="revoke-keys"
Jul 27 21:43:58.445661 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.445614    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="97df3de4-1663-4aa5-b853-c0e0e59c93e6" containerName="revoke-keys"
Jul 27 21:43:58.445661 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.445641    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" containerName="payload-processing"
Jul 27 21:43:58.445661 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.445647    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" containerName="payload-processing"
Jul 27 21:43:58.445758 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.445724    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1fc2bf7-b437-4d4a-b5eb-9cbd2c6b662a" containerName="payload-processing"
Jul 27 21:43:58.445758 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.445735    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="97df3de4-1663-4aa5-b853-c0e0e59c93e6" containerName="revoke-keys"
Jul 27 21:43:58.448933 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.448916    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"
Jul 27 21:43:58.451628 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.451604    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4fvvt\""
Jul 27 21:43:58.457522 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.457407    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"]
Jul 27 21:43:58.491667 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.491636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e1378-d8a5-482c-b910-15f683c86bc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm\" (UID: \"4c0e1378-d8a5-482c-b910-15f683c86bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"
Jul 27 21:43:58.593150 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.593113    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e1378-d8a5-482c-b910-15f683c86bc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm\" (UID: \"4c0e1378-d8a5-482c-b910-15f683c86bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"
Jul 27 21:43:58.593761 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.593744    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e1378-d8a5-482c-b910-15f683c86bc4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm\" (UID: \"4c0e1378-d8a5-482c-b910-15f683c86bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"
Jul 27 21:43:58.760688 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.760655    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"
Jul 27 21:43:58.905683 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:58.905655    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"]
Jul 27 21:43:58.908161 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:43:58.908134    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0e1378_d8a5_482c_b910_15f683c86bc4.slice/crio-718e6b69c0025b22efd06d2488e3181c900822e1555ee4f475e42e81341da4cc WatchSource:0}: Error finding container 718e6b69c0025b22efd06d2488e3181c900822e1555ee4f475e42e81341da4cc: Status 404 returned error can't find the container with id 718e6b69c0025b22efd06d2488e3181c900822e1555ee4f475e42e81341da4cc
Jul 27 21:43:59.584576 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:59.584521    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm" event={"ID":"4c0e1378-d8a5-482c-b910-15f683c86bc4","Type":"ContainerStarted","Data":"c69d5f81ce3ca9dcd6d703ce0a388b66af2712ee9a32cff2e0ad47b58e2e3276"}
Jul 27 21:43:59.584976 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:59.584598    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm" event={"ID":"4c0e1378-d8a5-482c-b910-15f683c86bc4","Type":"ContainerStarted","Data":"718e6b69c0025b22efd06d2488e3181c900822e1555ee4f475e42e81341da4cc"}
Jul 27 21:43:59.601277 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:43:59.601227    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm" podStartSLOduration=1.6012069850000001 podStartE2EDuration="1.601206985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:43:59.600181842 +0000 UTC m=+3165.896513162" watchObservedRunningTime="2026-07-27 21:43:59.601206985 +0000 UTC m=+3165.897538303"
Jul 27 21:44:00.595311 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:00.595275    2566 generic.go:356] "Generic (PLEG): container finished" podID="4c0e1378-d8a5-482c-b910-15f683c86bc4" containerID="c69d5f81ce3ca9dcd6d703ce0a388b66af2712ee9a32cff2e0ad47b58e2e3276" exitCode=0
Jul 27 21:44:00.595761 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:00.595347    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm" event={"ID":"4c0e1378-d8a5-482c-b910-15f683c86bc4","Type":"ContainerDied","Data":"c69d5f81ce3ca9dcd6d703ce0a388b66af2712ee9a32cff2e0ad47b58e2e3276"}
Jul 27 21:44:01.746427 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:01.746400    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"
Jul 27 21:44:01.827504 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:01.827466    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e1378-d8a5-482c-b910-15f683c86bc4-maas-api-service-ca\") pod \"4c0e1378-d8a5-482c-b910-15f683c86bc4\" (UID: \"4c0e1378-d8a5-482c-b910-15f683c86bc4\") "
Jul 27 21:44:01.827933 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:01.827908    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c0e1378-d8a5-482c-b910-15f683c86bc4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c0e1378-d8a5-482c-b910-15f683c86bc4" (UID: "4c0e1378-d8a5-482c-b910-15f683c86bc4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:44:01.928986 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:01.928901    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e1378-d8a5-482c-b910-15f683c86bc4-maas-api-service-ca\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:02.609892 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:02.609804    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"
Jul 27 21:44:02.609892 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:02.609799    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm" event={"ID":"4c0e1378-d8a5-482c-b910-15f683c86bc4","Type":"ContainerDied","Data":"718e6b69c0025b22efd06d2488e3181c900822e1555ee4f475e42e81341da4cc"}
Jul 27 21:44:02.610184 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:02.609930    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="718e6b69c0025b22efd06d2488e3181c900822e1555ee4f475e42e81341da4cc"
Jul 27 21:44:03.343198 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.343130    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:44:03.442289 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442233    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-certs\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442306    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-data\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442357    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-token\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442393    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-podinfo\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442430    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-envoy\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442476    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-socket\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442803 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442508    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-credential-socket\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442803 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442566    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xjhl\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-kube-api-access-7xjhl\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442803 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442618    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b5061a-55a8-4ed0-8faa-e0879abae181-istiod-ca-cert\") pod \"a5b5061a-55a8-4ed0-8faa-e0879abae181\" (UID: \"a5b5061a-55a8-4ed0-8faa-e0879abae181\") "
Jul 27 21:44:03.442961 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442827    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:44:03.442961 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.442907    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:44:03.443140 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.443061    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-credential-socket\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.443140 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.443105    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-certs\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.443140 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.443057    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:44:03.443140 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.443108    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5b5061a-55a8-4ed0-8faa-e0879abae181-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:44:03.443574 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.443151    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:44:03.445006 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.444974    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:44:03.445100 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.445007    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:44:03.445167 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.445111    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:44:03.445167 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.445134    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-kube-api-access-7xjhl" (OuterVolumeSpecName: "kube-api-access-7xjhl") pod "a5b5061a-55a8-4ed0-8faa-e0879abae181" (UID: "a5b5061a-55a8-4ed0-8faa-e0879abae181"). InnerVolumeSpecName "kube-api-access-7xjhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:44:03.544443 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.544410    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-token\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.544443 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.544437    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-podinfo\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.544443 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.544446    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-envoy\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.544443 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.544454    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-workload-socket\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.544743 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.544463    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xjhl\" (UniqueName: \"kubernetes.io/projected/a5b5061a-55a8-4ed0-8faa-e0879abae181-kube-api-access-7xjhl\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.544743 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.544473    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b5061a-55a8-4ed0-8faa-e0879abae181-istiod-ca-cert\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.544743 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.544481    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b5061a-55a8-4ed0-8faa-e0879abae181-istio-data\") on node \"ip-10-0-141-50.ec2.internal\" DevicePath \"\""
Jul 27 21:44:03.618056 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.617970    2566 generic.go:356] "Generic (PLEG): container finished" podID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerID="ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4" exitCode=0
Jul 27 21:44:03.618056 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.618039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" event={"ID":"a5b5061a-55a8-4ed0-8faa-e0879abae181","Type":"ContainerDied","Data":"ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4"}
Jul 27 21:44:03.618270 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.618082    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"
Jul 27 21:44:03.618270 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.618095    2566 scope.go:117] "RemoveContainer" containerID="ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4"
Jul 27 21:44:03.618270 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.618084    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw" event={"ID":"a5b5061a-55a8-4ed0-8faa-e0879abae181","Type":"ContainerDied","Data":"fc7bb2c96d2e80ce1b714d07780712e1c8b1ef87d555ebbc11dfab867d5bc772"}
Jul 27 21:44:03.628507 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.628487    2566 scope.go:117] "RemoveContainer" containerID="1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863"
Jul 27 21:44:03.637860 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.637832    2566 scope.go:117] "RemoveContainer" containerID="ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4"
Jul 27 21:44:03.638884 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:44:03.638848    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4\": container with ID starting with ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4 not found: ID does not exist" containerID="ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4"
Jul 27 21:44:03.638999 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.638897    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4"} err="failed to get container status \"ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4\": rpc error: code = NotFound desc = could not find container \"ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4\": container with ID starting with ac4447bbd81a9c36e3de348464f6fe5e9ef4aef6d9f0083505fc2f610a8e52d4 not found: ID does not exist"
Jul 27 21:44:03.638999 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.638926    2566 scope.go:117] "RemoveContainer" containerID="1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863"
Jul 27 21:44:03.639294 ip-10-0-141-50 kubenswrapper[2566]: E0727 21:44:03.639274    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863\": container with ID starting with 1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863 not found: ID does not exist" containerID="1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863"
Jul 27 21:44:03.639356 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.639308    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863"} err="failed to get container status \"1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863\": rpc error: code = NotFound desc = could not find container \"1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863\": container with ID starting with 1176164de3f06ceca6170d198339fcf78ba60caec701e888b43c59999d432863 not found: ID does not exist"
Jul 27 21:44:03.641110 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.641090    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"]
Jul 27 21:44:03.644748 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:03.644723    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-0e6399-openshift-default-85d7478d7b-g6phw"]
Jul 27 21:44:04.244623 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:04.244590    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" path="/var/lib/kubelet/pods/a5b5061a-55a8-4ed0-8faa-e0879abae181/volumes"
Jul 27 21:44:13.625508 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:13.625467    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"]
Jul 27 21:44:13.632823 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:13.632791    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c910ce-gvkhm"]
Jul 27 21:44:14.244127 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:14.244087    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c0e1378-d8a5-482c-b910-15f683c86bc4" path="/var/lib/kubelet/pods/4c0e1378-d8a5-482c-b910-15f683c86bc4/volumes"
Jul 27 21:44:47.851491 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:47.851461    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9lsj5_2c50b14f-c502-495f-b359-4805148edb9f/manager/0.log"
Jul 27 21:44:48.210725 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:48.210643    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sdcbd_3213cdbc-081d-433e-a695-036f51ae5da7/server/0.log"
Jul 27 21:44:48.321641 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:48.321607    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7wjzv_11f37e92-f71b-4d9b-99ec-ab96671a5f41/manager/0.log"
Jul 27 21:44:48.428524 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:48.428495    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d_9efa8706-dc9a-4c73-9bf1-39653afaf48d/copy-manifests/0.log"
Jul 27 21:44:48.440077 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:48.440048    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d_9efa8706-dc9a-4c73-9bf1-39653afaf48d/manager/0.log"
Jul 27 21:44:48.989651 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:48.989628    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65694fbd5f-p9tmn_18a809de-25de-4e54-bced-7c8c2d637d2b/maas-api/0.log"
Jul 27 21:44:49.298216 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:49.298073    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-655hs_940360ec-1990-4f30-92e3-38bfb426e6e7/postgres/0.log"
Jul 27 21:44:50.150764 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:50.150734    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6_4ff2ef69-bef6-4685-9e95-6fd35e0cb52a/util/0.log"
Jul 27 21:44:50.158463 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:50.158436    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6_4ff2ef69-bef6-4685-9e95-6fd35e0cb52a/pull/0.log"
Jul 27 21:44:50.164246 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:50.164225    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6_4ff2ef69-bef6-4685-9e95-6fd35e0cb52a/extract/0.log"
Jul 27 21:44:50.390401 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:50.390363    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz_5159abf3-0759-4c67-9fcd-24ce4b08ee41/util/0.log"
Jul 27 21:44:50.396231 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:50.396201    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz_5159abf3-0759-4c67-9fcd-24ce4b08ee41/pull/0.log"
Jul 27 21:44:50.401630 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:50.401526    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz_5159abf3-0759-4c67-9fcd-24ce4b08ee41/extract/0.log"
Jul 27 21:44:51.061444 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:51.061415    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-s58wq_124d9c8e-b0ee-4c47-8fce-d9cb6d273830/manager/0.log"
Jul 27 21:44:51.710468 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:51.710422    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x4g98_62739725-1733-47cd-9dfc-c42c1a6ce489/discovery/0.log"
Jul 27 21:44:51.816981 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:51.816947    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f4ccdc5cb-45zfl_8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01/kube-auth-proxy/0.log"
Jul 27 21:44:52.158961 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:52.158930    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-dnpxs_514ca926-21a1-46cc-8e13-c0281ecd5d1a/payload-pre-processing/0.log"
Jul 27 21:44:52.268660 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:52.268631    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8zrzr_e2c6ae0c-916b-4a64-9085-2c9604df477a/payload-processing/0.log"
Jul 27 21:44:52.370982 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:52.370953    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dfcf8dbf5-2qk2g_9ef9bc58-faac-4b38-a236-44cf12a4708f/router/0.log"
Jul 27 21:44:52.697041 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:52.697014    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-t85rf_49b170d1-d54b-4b66-abc4-749fb5e7f057/main/0.log"
Jul 27 21:44:52.916980 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:52.916952    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-t5mj2_8a904085-e184-4ec1-a523-0b8af28205bc/main/0.log"
Jul 27 21:44:53.132052 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:44:53.132022    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gdg2l_bde86cee-cefb-4f86-ab63-029f6720c1a1/main/0.log"
Jul 27 21:45:01.566809 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:01.566778    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q2zh7_de21674c-cccb-4c0e-af96-c949e951b0d4/global-pull-secret-syncer/0.log"
Jul 27 21:45:01.747576 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:01.747524    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x58zc_6d5b0a16-dbc4-4b87-ae82-f63eb2a27de5/konnectivity-agent/0.log"
Jul 27 21:45:01.814739 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:01.814710    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-50.ec2.internal_2efc845f7ae190bc5a73ce1b56253af6/haproxy/0.log"
Jul 27 21:45:06.562228 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:06.562185    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6_4ff2ef69-bef6-4685-9e95-6fd35e0cb52a/extract/0.log"
Jul 27 21:45:06.580629 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:06.580603    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6_4ff2ef69-bef6-4685-9e95-6fd35e0cb52a/util/0.log"
Jul 27 21:45:06.599411 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:06.599386    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qjgz6_4ff2ef69-bef6-4685-9e95-6fd35e0cb52a/pull/0.log"
Jul 27 21:45:06.699063 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:06.699034    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz_5159abf3-0759-4c67-9fcd-24ce4b08ee41/extract/0.log"
Jul 27 21:45:06.722610 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:06.722572    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz_5159abf3-0759-4c67-9fcd-24ce4b08ee41/util/0.log"
Jul 27 21:45:06.754512 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:06.754485    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kcbcz_5159abf3-0759-4c67-9fcd-24ce4b08ee41/pull/0.log"
Jul 27 21:45:07.676993 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:07.676959    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-s58wq_124d9c8e-b0ee-4c47-8fce-d9cb6d273830/manager/0.log"
Jul 27 21:45:09.655241 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.655210    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-d6wg8_01b19404-7d81-4a66-8720-5e202c95078c/cluster-monitoring-operator/0.log"
Jul 27 21:45:09.704338 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.704305    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-f8zzh_9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08/kube-state-metrics/0.log"
Jul 27 21:45:09.725368 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.725339    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-f8zzh_9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08/kube-rbac-proxy-main/0.log"
Jul 27 21:45:09.745056 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.745026    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-f8zzh_9bb3a37f-b7bb-4fef-a1dd-e42460b7ee08/kube-rbac-proxy-self/0.log"
Jul 27 21:45:09.767725 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.767701    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6485545b46-8d7dz_cc861518-73a7-40c0-9e3f-f33bab1929ba/metrics-server/0.log"
Jul 27 21:45:09.795204 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.795179    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-mp8t4_ef3f02bd-7b18-48e3-bcee-466a8ec91038/monitoring-plugin/0.log"
Jul 27 21:45:09.823216 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.823187    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k42r7_dde0b560-93eb-4219-b1f5-50687e33ee16/node-exporter/0.log"
Jul 27 21:45:09.843776 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.843754    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k42r7_dde0b560-93eb-4219-b1f5-50687e33ee16/kube-rbac-proxy/0.log"
Jul 27 21:45:09.860963 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:09.860942    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k42r7_dde0b560-93eb-4219-b1f5-50687e33ee16/init-textfile/0.log"
Jul 27 21:45:10.023400 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:10.023354    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-f8hbk_9b63e3e1-4c64-4d02-94b9-40c4835f3c74/kube-rbac-proxy-main/0.log"
Jul 27 21:45:10.047685 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:10.047659    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-f8hbk_9b63e3e1-4c64-4d02-94b9-40c4835f3c74/kube-rbac-proxy-self/0.log"
Jul 27 21:45:10.069709 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:10.069681    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-f8hbk_9b63e3e1-4c64-4d02-94b9-40c4835f3c74/openshift-state-metrics/0.log"
Jul 27 21:45:10.296268 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:10.296164    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-djj8d_62f303e8-c2bc-47c9-b421-89b833d6cc90/prometheus-operator-admission-webhook/0.log"
Jul 27 21:45:11.443374 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443328    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"]
Jul 27 21:45:11.443771 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443735    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy"
Jul 27 21:45:11.443771 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443747    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy"
Jul 27 21:45:11.443771 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443770    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0e1378-d8a5-482c-b910-15f683c86bc4" containerName="revoke-keys"
Jul 27 21:45:11.443869 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443776    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0e1378-d8a5-482c-b910-15f683c86bc4" containerName="revoke-keys"
Jul 27 21:45:11.443869 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443785    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy"
Jul 27 21:45:11.443869 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443789    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy"
Jul 27 21:45:11.443869 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443848    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy"
Jul 27 21:45:11.443869 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443856    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0e1378-d8a5-482c-b910-15f683c86bc4" containerName="revoke-keys"
Jul 27 21:45:11.443869 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.443861    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5b5061a-55a8-4ed0-8faa-e0879abae181" containerName="istio-proxy"
Jul 27 21:45:11.447288 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.447267    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.449987 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.449965    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d7w9b\"/\"kube-root-ca.crt\""
Jul 27 21:45:11.450111 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.449997    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d7w9b\"/\"openshift-service-ca.crt\""
Jul 27 21:45:11.451009 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.450992    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d7w9b\"/\"default-dockercfg-vqvld\""
Jul 27 21:45:11.457061 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.457038    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"]
Jul 27 21:45:11.596120 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.596079    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-podres\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.596306 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.596137    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lknz\" (UniqueName: \"kubernetes.io/projected/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-kube-api-access-9lknz\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.596306 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.596220    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-sys\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.596306 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.596284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-lib-modules\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.596438 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.596328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-proc\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.697920 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.697831    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lknz\" (UniqueName: \"kubernetes.io/projected/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-kube-api-access-9lknz\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.697920 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.697874    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-sys\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.697920 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.697916    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-lib-modules\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.698152 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.697961    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-proc\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.698152 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.698004    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-podres\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.698152 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.698031    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-sys\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.698152 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.698090    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-lib-modules\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.698152 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.698109    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-proc\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.698152 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.698126    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-podres\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.715067 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.715038    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lknz\" (UniqueName: \"kubernetes.io/projected/d9e6db6b-b780-4510-8b88-5cb8aa6f288e-kube-api-access-9lknz\") pod \"perf-node-gather-daemonset-ncths\" (UID: \"d9e6db6b-b780-4510-8b88-5cb8aa6f288e\") " pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.758164 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.758129    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:11.901682 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:11.901650    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"]
Jul 27 21:45:11.903710 ip-10-0-141-50 kubenswrapper[2566]: W0727 21:45:11.903684    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd9e6db6b_b780_4510_8b88_5cb8aa6f288e.slice/crio-3d3c73e2c72b61e52d2de3d112bcd6e9c67b320e5e581961d21952873c206ed6 WatchSource:0}: Error finding container 3d3c73e2c72b61e52d2de3d112bcd6e9c67b320e5e581961d21952873c206ed6: Status 404 returned error can't find the container with id 3d3c73e2c72b61e52d2de3d112bcd6e9c67b320e5e581961d21952873c206ed6
Jul 27 21:45:12.015211 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:12.015182    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths" event={"ID":"d9e6db6b-b780-4510-8b88-5cb8aa6f288e","Type":"ContainerStarted","Data":"3d3c73e2c72b61e52d2de3d112bcd6e9c67b320e5e581961d21952873c206ed6"}
Jul 27 21:45:12.314627 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:12.314596    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/1.log"
Jul 27 21:45:12.319742 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:12.319717    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-drwv8_880360ca-b783-4ce8-bad4-c16921652ffe/console-operator/2.log"
Jul 27 21:45:12.762292 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:12.762261    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97bd5758d-9kxns_1f679df2-b325-49b5-9e01-bb72e88dfa36/console/0.log"
Jul 27 21:45:12.800162 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:12.800130    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-s57tl_5e5b7643-5d9b-454f-a70c-16078e079785/download-server/0.log"
Jul 27 21:45:13.021679 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:13.021567    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths" event={"ID":"d9e6db6b-b780-4510-8b88-5cb8aa6f288e","Type":"ContainerStarted","Data":"693d21d89b3f0bb7963dda981c77531a9a59201b4d6b06ce2317fd0f2bf79f5c"}
Jul 27 21:45:13.021679 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:13.021648    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:13.040161 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:13.040107    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths" podStartSLOduration=2.040091765 podStartE2EDuration="2.040091765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:45:13.039715481 +0000 UTC m=+3239.336046799" watchObservedRunningTime="2026-07-27 21:45:13.040091765 +0000 UTC m=+3239.336423144"
Jul 27 21:45:14.397251 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:14.397222    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6w65b_109f9738-5bb9-4746-99d9-46a79be61ead/dns/0.log"
Jul 27 21:45:14.418731 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:14.418704    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6w65b_109f9738-5bb9-4746-99d9-46a79be61ead/kube-rbac-proxy/0.log"
Jul 27 21:45:14.489231 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:14.489203    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7tnkz_13bd8697-f1fe-44bc-a652-50a9903c07d5/dns-node-resolver/0.log"
Jul 27 21:45:15.089194 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:15.089162    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78f8898599-mhm9t_1eacdaf8-6bb6-4dec-88fe-7385b19861ad/registry/0.log"
Jul 27 21:45:15.111900 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:15.111869    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-72wr4_251732b1-eb60-40ec-bf31-81a031ab1393/node-ca/0.log"
Jul 27 21:45:16.308273 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:16.308245    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x4g98_62739725-1733-47cd-9dfc-c42c1a6ce489/discovery/0.log"
Jul 27 21:45:16.330762 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:16.330733    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f4ccdc5cb-45zfl_8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01/kube-auth-proxy/0.log"
Jul 27 21:45:16.491691 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:16.491656    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-dnpxs_514ca926-21a1-46cc-8e13-c0281ecd5d1a/payload-pre-processing/0.log"
Jul 27 21:45:16.519286 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:16.519254    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8zrzr_e2c6ae0c-916b-4a64-9085-2c9604df477a/payload-processing/0.log"
Jul 27 21:45:16.542828 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:16.542803    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dfcf8dbf5-2qk2g_9ef9bc58-faac-4b38-a236-44cf12a4708f/router/0.log"
Jul 27 21:45:17.383055 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:17.383028    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5csbs_626400fd-a7c4-443c-9ced-94c2b1302ed3/serve-healthcheck-canary/0.log"
Jul 27 21:45:17.890845 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:17.890815    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-7rqb6_d445e555-f3e6-446b-b8cc-0f2f75019637/insights-operator/0.log"
Jul 27 21:45:17.891494 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:17.891457    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-7rqb6_d445e555-f3e6-446b-b8cc-0f2f75019637/insights-operator/1.log"
Jul 27 21:45:18.033733 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:18.033706    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zdmkv_01bd2105-a14a-427d-8cf6-a7b356114fbc/kube-rbac-proxy/0.log"
Jul 27 21:45:18.054502 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:18.054475    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zdmkv_01bd2105-a14a-427d-8cf6-a7b356114fbc/exporter/0.log"
Jul 27 21:45:18.073611 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:18.073585    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zdmkv_01bd2105-a14a-427d-8cf6-a7b356114fbc/extractor/0.log"
Jul 27 21:45:19.042090 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:19.042063    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d7w9b/perf-node-gather-daemonset-ncths"
Jul 27 21:45:20.369231 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:20.369149    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9lsj5_2c50b14f-c502-495f-b359-4805148edb9f/manager/0.log"
Jul 27 21:45:21.044831 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:21.044805    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sdcbd_3213cdbc-081d-433e-a695-036f51ae5da7/server/0.log"
Jul 27 21:45:21.129001 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:21.128969    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7wjzv_11f37e92-f71b-4d9b-99ec-ab96671a5f41/manager/0.log"
Jul 27 21:45:21.211808 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:21.211771    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d_9efa8706-dc9a-4c73-9bf1-39653afaf48d/manager/0.log"
Jul 27 21:45:21.229017 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:21.228989    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4c7b8d87-bbr6d_9efa8706-dc9a-4c73-9bf1-39653afaf48d/copy-manifests/0.log"
Jul 27 21:45:21.992546 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:21.992473    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x4g98_62739725-1733-47cd-9dfc-c42c1a6ce489/discovery/0.log"
Jul 27 21:45:22.003097 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:22.003069    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f4ccdc5cb-45zfl_8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01/kube-auth-proxy/0.log"
Jul 27 21:45:22.110187 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:22.110147    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-dnpxs_514ca926-21a1-46cc-8e13-c0281ecd5d1a/payload-pre-processing/0.log"
Jul 27 21:45:22.129603 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:22.129576    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8zrzr_e2c6ae0c-916b-4a64-9085-2c9604df477a/payload-processing/0.log"
Jul 27 21:45:22.141246 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:22.141218    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dfcf8dbf5-2qk2g_9ef9bc58-faac-4b38-a236-44cf12a4708f/router/0.log"
Jul 27 21:45:23.718732 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:23.718690    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x4g98_62739725-1733-47cd-9dfc-c42c1a6ce489/discovery/0.log"
Jul 27 21:45:23.730644 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:23.730619    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f4ccdc5cb-45zfl_8a3746f0-f8e6-4d7b-9caf-9a5c5ec35f01/kube-auth-proxy/0.log"
Jul 27 21:45:23.845566 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:23.845520    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-dnpxs_514ca926-21a1-46cc-8e13-c0281ecd5d1a/payload-pre-processing/0.log"
Jul 27 21:45:23.864197 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:23.864164    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8zrzr_e2c6ae0c-916b-4a64-9085-2c9604df477a/payload-processing/0.log"
Jul 27 21:45:23.881902 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:23.881877    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dfcf8dbf5-2qk2g_9ef9bc58-faac-4b38-a236-44cf12a4708f/router/0.log"
Jul 27 21:45:27.740869 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:27.740837    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x_2e6ad5f3-23f4-44fd-a874-1b9313fad533/kube-storage-version-migrator-operator/1.log"
Jul 27 21:45:27.741687 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:27.741669    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-fxj9x_2e6ad5f3-23f4-44fd-a874-1b9313fad533/kube-storage-version-migrator-operator/0.log"
Jul 27 21:45:28.786365 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:28.786331    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8lj7n_a7a5764f-13bb-42f3-8849-18b1e549631c/kube-multus/0.log"
Jul 27 21:45:28.814929 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:28.814905    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8pcm_0b901120-f94d-49bf-8098-cd196b635d7a/kube-multus-additional-cni-plugins/0.log"
Jul 27 21:45:28.833573 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:28.833524    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8pcm_0b901120-f94d-49bf-8098-cd196b635d7a/egress-router-binary-copy/0.log"
Jul 27 21:45:28.855142 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:28.855112    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8pcm_0b901120-f94d-49bf-8098-cd196b635d7a/cni-plugins/0.log"
Jul 27 21:45:28.875510 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:28.875483    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8pcm_0b901120-f94d-49bf-8098-cd196b635d7a/bond-cni-plugin/0.log"
Jul 27 21:45:28.895160 ip-10-0-141-50 kubenswrapper[2566]: I0727 21:45:28.895127    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8pcm_0b901120-f94d-49bf-8098-cd196b635d7a/routeoverride-cni/0.log"