Jul 31 00:04:11.747424 ip-10-0-143-7 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 00:04:11.747435 ip-10-0-143-7 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 00:04:11.747442 ip-10-0-143-7 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 00:04:11.747691 ip-10-0-143-7 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 00:04:21.996591 ip-10-0-143-7 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 31 00:04:21.996610 ip-10-0-143-7 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 737f1f2299514b9fa05e182cd8583720 --
Jul 31 00:05:57.998816 ip-10-0-143-7 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 00:05:58.443016 ip-10-0-143-7 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 00:05:58.443016 ip-10-0-143-7 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 00:05:58.443016 ip-10-0-143-7 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 00:05:58.443016 ip-10-0-143-7 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 00:05:58.443016 ip-10-0-143-7 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 00:05:58.443760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.443092    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 00:05:58.451584 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451558    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:05:58.451584 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451582    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:05:58.451584 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451586    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451590    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451594    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451598    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451601    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451604    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451607    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451609    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451612    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451614    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451617    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451620    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451623    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451626    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451628    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451632    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451635    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451640    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451644    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451647    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:05:58.451691 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451650    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451652    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451656    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451658    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451661    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451664    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451667    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451670    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451673    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451676    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451679    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451682    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451685    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451689    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451694    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451697    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451700    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451703    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451706    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:05:58.452322 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451709    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451712    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451714    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451717    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451720    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451722    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451726    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451729    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451731    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451734    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451737    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451740    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451742    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451745    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451747    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451750    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451752    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451754    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451757    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451760    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:05:58.453081 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451762    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451765    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451768    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451770    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451773    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451776    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451778    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451782    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451785    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451787    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451790    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451792    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451795    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451797    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451801    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451804    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451806    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451809    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451811    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451814    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:05:58.453606 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451817    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451819    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451822    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451825    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451827    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451830    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451833    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451835    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451839    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451843    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451846    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451848    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451851    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451853    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451856    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451860    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451863    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:05:58.454171 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.451865    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:05:58.455382 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455361    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:05:58.455382 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455384    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:05:58.455445 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455390    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:05:58.455445 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455394    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:05:58.455445 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455398    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:05:58.455445 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455402    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:05:58.455445 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455436    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:05:58.455445 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455442    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:05:58.455445 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455446    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455468    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455473    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455477    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455482    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455486    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455490    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455494    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455498    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455502    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455507    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455510    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455513    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455517    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455521    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455525    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455528    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455532    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455536    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455540    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:05:58.455642 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455544    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455548    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455552    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455556    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455560    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455564    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455567    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455571    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455575    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455578    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455583    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455586    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455590    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455594    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455599    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455602    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455607    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455611    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455615    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455619    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:05:58.456136 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455623    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455627    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455632    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455636    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455640    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455644    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455648    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455652    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455656    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455661    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455666    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455672    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455677    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455681    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455685    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455690    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455694    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455698    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455701    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:05:58.456652 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455705    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455713    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455718    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455723    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455727    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455731    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455734    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455740    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455744    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455748    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455752    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455756    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455760    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455764    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455768    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455771    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455776    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455780    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455786    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:05:58.457264 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455790    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455793    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455797    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455801    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455804    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455809    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455813    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455817    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455820    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455824    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455827    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455831    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.455835    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456382    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456388    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456392    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456396    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456399    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456403    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456408    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:05:58.457755 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456413    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456416    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456420    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456424    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456428    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456432    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456435    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456440    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456444    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456449    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456472    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456476    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456480    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456484    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456488    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456492    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456496    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456502    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456508    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:05:58.458235 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456512    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456516    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456521    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456525    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456529    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456533    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456537    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456541    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456545    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456549    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456553    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456557    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456561    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456566    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456569    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456573    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456577    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456581    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456585    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:05:58.458772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456589    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456593    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456598    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456603    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456608    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456612    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456616    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456620    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456624    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456628    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456631    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456635    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456638    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456642    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456646    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456649    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456652    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456657    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456661    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:05:58.459240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456665    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456669    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456672    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456677    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456681    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456685    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456689    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456693    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456697    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456700    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456704    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456708    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456712    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456717    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456721    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456724    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456728    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456732    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456736    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456740    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:05:58.459715 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456743    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456748    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456751    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456755    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456758    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456762    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456768    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456772    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456775    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456779    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456783    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456786    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456790    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456795    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.456801    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456890    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456900    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456910    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456917    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456923    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456928    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 00:05:58.460239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456934    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456941    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456946    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456951    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456956    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456962    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456966    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456971    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456975    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456979    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456984    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456989    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456995    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.456999    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457003    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457008    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457013    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457018    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457023    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457027    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457032    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457036    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457044    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457048    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 00:05:58.460760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457052    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457056    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457063    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457067    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457071    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457075    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457080    2582 flags.go:64] FLAG: --enable-server="true"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457084    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457091    2582 flags.go:64] FLAG: --event-burst="100"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457096    2582 flags.go:64] FLAG: --event-qps="50"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457100    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457104    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457108    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457114    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457119    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457123    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457127    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457132    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457136    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457141    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457146    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457150    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457154    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457159    2582 flags.go:64] FLAG: --feature-gates=""
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457165    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 00:05:58.461336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457169    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457174    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457178    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457183    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457187    2582 flags.go:64] FLAG: --help="false"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457193    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457198    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457203    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457207    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457212    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457217    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457222    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457226    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457231    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457236    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457240    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457245    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457249    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457254    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457259    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457263    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457267    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457272    2582 flags.go:64] FLAG: --lock-file=""
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457276    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 00:05:58.461977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457281    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457286    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457294    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457299    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457303    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457307    2582 flags.go:64] FLAG: --logging-format="text"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457312    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457317    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457321    2582 flags.go:64] FLAG: --manifest-url=""
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457325    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457331    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457335    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457342    2582 flags.go:64] FLAG: --max-pods="110"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457347    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457351    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457355    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457360    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457364    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457368    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457375    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457385    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457390    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457394    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 00:05:58.462588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457399    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457403    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457412    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457416    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457420    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457425    2582 flags.go:64] FLAG: --port="10250"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457429    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457433    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f036cea6ef79fb64"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457438    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457442    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457447    2582 flags.go:64] FLAG: --register-node="true"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457463    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457469    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457475    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457479    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457483    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457489    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457493    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457498    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457502    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457506    2582 flags.go:64] FLAG: --runonce="false"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457511    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457515    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457519    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457524    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 00:05:58.463185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457528    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457532    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457537    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457543    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457548    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457552    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457557    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457562    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457566    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457570    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457575    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457583    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457587    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457591    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457597    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457601    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457605    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457610    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457614    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457619    2582 flags.go:64] FLAG: --v="2"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457625    2582 flags.go:64] FLAG: --version="false"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457631    2582 flags.go:64] FLAG: --vmodule=""
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457641    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.457646    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457818    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:05:58.463853 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457825    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457829    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457833    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457837    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457841    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457845    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457849    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457853    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457857    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457860    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457865    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457869    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457873    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457876    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457880    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457886    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457891    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457894    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457899    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457903    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:05:58.464467 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457906    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457910    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457913    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457917    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457921    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457925    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457929    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457933    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457937    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457942    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457945    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457949    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457952    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457957    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457960    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457966    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457972    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457976    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457987    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:05:58.464994 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457992    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457996    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.457999    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458003    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458007    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458011    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458014    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458018    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458022    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458026    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458029    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458033    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458036    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458040    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458044    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458048    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458051    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458055    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458059    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458062    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:05:58.465521 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458066    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458069    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458073    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458079    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458084    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458087    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458095    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458099    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458102    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458106    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458109    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458114    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458117    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458121    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458126    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458130    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458134    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458137    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458141    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:05:58.466037 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458145    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458149    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458153    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458156    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458160    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458164    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458168    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458171    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458177    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458183    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458187    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458191    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458195    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458199    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458203    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458206    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458210    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458215    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458219    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:05:58.466519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.458224    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:05:58.466996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.458970    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 00:05:58.467078 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.467055    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 00:05:58.467110 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.467081    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 00:05:58.467110 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.467104    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 00:05:58.467159 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.467111    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 00:05:58.467207 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467197    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467207    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467212    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467216    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467220    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467225    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467228    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467232    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467237    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:05:58.467240 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467241    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467247    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467253    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467258    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467263    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467267    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467271    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467276    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467280    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467284    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467289    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467292    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467296    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467300    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467304    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467309    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467312    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467315    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467319    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:05:58.467480 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467324    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467328    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467331    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467334    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467338    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467342    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467346    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467349    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467353    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467357    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467360    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467364    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467368    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467372    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467376    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467382    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467387    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467393    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467397    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467401    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:05:58.467935 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467404    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467409    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467413    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467416    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467419    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467423    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467428    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467432    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467435    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467439    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467443    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467447    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467464    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467469    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467473    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467476    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467480    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467484    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467490    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467496    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:05:58.468426 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467500    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467504    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467508    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467512    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467516    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467520    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467525    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467529    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467533    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467536    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467539    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467543    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467547    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467550    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467554    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467558    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467562    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467565    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467569    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467573    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:05:58.468938 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467577    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467581    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467585    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467589    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467592    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467596    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467599    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467603    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467606    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467610    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467614    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.467621    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467792    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467800    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467804    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 00:05:58.469443 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467808    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467812    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467816    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467820    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467826    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467833    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467837    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467841    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467846    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467851    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467854    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467858    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467863    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467866    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467870    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467874    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467877    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467882    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467886    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 00:05:58.469833 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467889    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467893    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467898    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467903    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467907    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467911    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467915    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467919    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467922    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467926    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467930    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467934    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467938    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467942    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467946    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467951    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467955    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467958    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467962    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467966    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 00:05:58.470293 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467970    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467974    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467977    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467981    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467985    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467990    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.467996    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468001    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468005    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468009    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468013    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468017    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468021    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468026    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468030    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468035    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468039    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468044    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468048    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 00:05:58.470812 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468052    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468057    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468060    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468064    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468068    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468072    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468076    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468079    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468083    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468087    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468091    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468095    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468099    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468102    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468106    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468110    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468114    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468118    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468121    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468126    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 00:05:58.471269 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468129    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468134    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468137    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468141    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468145    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468148    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468152    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468156    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468160    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468164    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468168    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468172    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468176    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468180    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468183    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468187    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468190    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 00:05:58.471849 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:05:58.468194    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 00:05:58.472265 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.468201    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 00:05:58.472265 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.468377    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 00:05:58.472265 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.471398    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 00:05:58.473161 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.473148    2582 server.go:1019] "Starting client certificate rotation"
Jul 31 00:05:58.473274 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.473255    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 00:05:58.473314 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.473300    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 00:05:58.476331 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.476313    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 00:05:58.478095 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.478073    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 00:05:58.489836 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.489812    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 31 00:05:58.493936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.493917    2582 log.go:25] "Validated CRI v1 image API"
Jul 31 00:05:58.494864 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.494842    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 00:05:58.498431 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.498407    2582 fs.go:135] Filesystem UUIDs: map[03e83491-468f-4fa5-985f-d3da09d1eccd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8628218d-3071-4b99-ad73-ba7b0478b132:/dev/nvme0n1p3]
Jul 31 00:05:58.498513 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.498428    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 00:05:58.504174 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.504046    2582 manager.go:216] Machine: {Timestamp:2026-07-31 00:05:58.502631449 +0000 UTC m=+0.375045101 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098366 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec218132c1800d0f830410d5583d0016 SystemUUID:ec218132-c180-0d0f-8304-10d5583d0016 BootID:737f1f22-9951-4b9f-a05e-182cd8583720 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:1d:f6:a0:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:1d:f6:a0:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:c9:22:43:43:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 00:05:58.504174 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.504162    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 00:05:58.504314 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.504296    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 00:05:58.505560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.505543    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 00:05:58.508121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.508092    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 00:05:58.508309 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.508128    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 00:05:58.509607 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.509593    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 00:05:58.509673 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.509615    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 00:05:58.509673 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.509632    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 00:05:58.510404 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.510391    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 00:05:58.511840 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.511828    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 00:05:58.517167 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517150    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 00:05:58.517330 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517318    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 00:05:58.517399 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517359    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 00:05:58.517399 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517375    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 00:05:58.517399 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517396    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 00:05:58.517540 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517410    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 31 00:05:58.517540 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517426    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 00:05:58.517858 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517845    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 00:05:58.517936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.517868    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 00:05:58.520539 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.520525    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 00:05:58.522721 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.522705    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 00:05:58.522769 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.522754    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 00:05:58.524247 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524235    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 00:05:58.524296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524259    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 00:05:58.524296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524266    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 00:05:58.524296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524271    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 00:05:58.524296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524279    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 00:05:58.524296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524285    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 00:05:58.524296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524294    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 00:05:58.524444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524299    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 00:05:58.524444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524307    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 00:05:58.524444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524312    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 00:05:58.524444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524325    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 00:05:58.524444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.524330    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 00:05:58.525999 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.525988    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 00:05:58.525999 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.525999    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 00:05:58.529103 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.529081    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 00:05:58.529103 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.529076    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 00:05:58.529235 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.529156    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 00:05:58.529536 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.529523    2582 server.go:1268] "Started kubelet"
Jul 31 00:05:58.529793 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.529721    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 00:05:58.529853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.529833    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 00:05:58.529940 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.529781    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 00:05:58.530690 ip-10-0-143-7 systemd[1]: Started Kubernetes Kubelet.
Jul 31 00:05:58.531985 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.531967    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 00:05:58.532565 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.532549    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 00:05:58.536066 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.536041    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 00:05:58.538511 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.535994    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-7.ec2.internal.18c737192c1cb3fa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-7.ec2.internal,UID:ip-10-0-143-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-7.ec2.internal,},FirstTimestamp:2026-07-31 00:05:58.529479674 +0000 UTC m=+0.401893328,LastTimestamp:2026-07-31 00:05:58.529479674 +0000 UTC m=+0.401893328,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-7.ec2.internal,}"
Jul 31 00:05:58.539293 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.539279    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 00:05:58.539341 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.539314    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 00:05:58.539386 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.539367    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:05:58.540334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540083    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 00:05:58.540334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540084    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 00:05:58.540334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540111    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 00:05:58.540334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540268    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 00:05:58.540334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540276    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 00:05:58.540856 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540722    2582 factory.go:55] Registering systemd factory
Jul 31 00:05:58.540856 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540740    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 31 00:05:58.540995 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540984    2582 factory.go:153] Registering CRI-O factory
Jul 31 00:05:58.541040 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.540996    2582 factory.go:223] Registration of the crio container factory successfully
Jul 31 00:05:58.541086 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.541046    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 00:05:58.541086 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.541068    2582 factory.go:103] Registering Raw factory
Jul 31 00:05:58.541086 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.541085    2582 manager.go:1196] Started watching for new ooms in manager
Jul 31 00:05:58.541445 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.541434    2582 manager.go:349] Starting recovery of all containers
Jul 31 00:05:58.544522 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.544491    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 00:05:58.544522 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.544497    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 00:05:58.549682 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.548425    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vgbmh"
Jul 31 00:05:58.551831 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.551812    2582 manager.go:354] Recovery completed
Jul 31 00:05:58.553323 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.553305    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vgbmh"
Jul 31 00:05:58.557372 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.557359    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:05:58.559408 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.559393    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:05:58.559512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.559437    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:05:58.559512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.559464    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:05:58.560118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.560103    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 00:05:58.560118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.560115    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 00:05:58.560258 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.560122    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:05:58.560258 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.560133    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 00:05:58.561086 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.561067    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:05:58.561175 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.561104    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:05:58.561175 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.561124    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:05:58.561754 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.561660    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-7.ec2.internal.18c737192de561f4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-7.ec2.internal,UID:ip-10-0-143-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-7.ec2.internal,},FirstTimestamp:2026-07-31 00:05:58.559408628 +0000 UTC m=+0.431822285,LastTimestamp:2026-07-31 00:05:58.559408628 +0000 UTC m=+0.431822285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-7.ec2.internal,}"
Jul 31 00:05:58.562158 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.562145    2582 policy_none.go:49] "None policy: Start"
Jul 31 00:05:58.562209 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.562162    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 00:05:58.562209 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.562172    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 00:05:58.564088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.564077    2582 policy_none.go:47] "Start"
Jul 31 00:05:58.601426 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.601206    2582 manager.go:337] "Starting Device Plugin manager"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.601482    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.601497    2582 server.go:87] "Starting device plugin registration server"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.601782    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.601794    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.601931    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.602023    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.602032    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.602690    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 00:05:58.621069 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.602763    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:05:58.645081 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.645035    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 00:05:58.646332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.646311    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 00:05:58.646379 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.646356    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 00:05:58.646413 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.646384    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 00:05:58.646444 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.646426    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 00:05:58.648198 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.648173    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:05:58.702404 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.702300    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:05:58.704276 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.704245    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:05:58.704404 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.704289    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:05:58.704404 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.704304    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:05:58.704404 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.704329    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.715258 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.715233    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.715258 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.715260    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-7.ec2.internal\": node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:05:58.738170 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.738137    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:05:58.746537 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.746509    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"]
Jul 31 00:05:58.746718 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.746592    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:05:58.748165 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.748144    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:05:58.748266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.748176    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:05:58.748266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.748191    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:05:58.750633 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.750616    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:05:58.750742 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.750725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.750803 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.750762    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:05:58.751424 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.751409    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:05:58.751499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.751437    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:05:58.751499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.751447    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:05:58.751499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.751410    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:05:58.751499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.751491    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:05:58.751615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.751501    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:05:58.753705 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.753691    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.753743 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.753720    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 00:05:58.754424 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.754406    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 00:05:58.754497 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.754440    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 00:05:58.754699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.754685    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeHasSufficientPID"
Jul 31 00:05:58.781286 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.781253    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-7.ec2.internal\" not found" node="ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.785758 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.785741    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-7.ec2.internal\" not found" node="ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.839080 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.839054    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:05:58.842332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.842318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7884b403dc3402323142f0de6f6cf966-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"7884b403dc3402323142f0de6f6cf966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.842400 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.842339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7884b403dc3402323142f0de6f6cf966-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"7884b403dc3402323142f0de6f6cf966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.842400 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.842356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13a70a09f2dffef1bbceb86aac02062a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.ec2.internal\" (UID: \"13a70a09f2dffef1bbceb86aac02062a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.939560 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:05:58.939518    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:05:58.942785 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.942763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7884b403dc3402323142f0de6f6cf966-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"7884b403dc3402323142f0de6f6cf966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.942850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.942791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7884b403dc3402323142f0de6f6cf966-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"7884b403dc3402323142f0de6f6cf966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.942850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.942800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7884b403dc3402323142f0de6f6cf966-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"7884b403dc3402323142f0de6f6cf966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.942850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.942829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7884b403dc3402323142f0de6f6cf966-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal\" (UID: \"7884b403dc3402323142f0de6f6cf966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.942850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.942847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13a70a09f2dffef1bbceb86aac02062a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.ec2.internal\" (UID: \"13a70a09f2dffef1bbceb86aac02062a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 31 00:05:58.942980 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:05:58.942869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13a70a09f2dffef1bbceb86aac02062a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.ec2.internal\" (UID: \"13a70a09f2dffef1bbceb86aac02062a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 31 00:06:00.635409 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:00.635376    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:06:00.679721 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:00.679699    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:06:00.683610 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:00.683592    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 31 00:06:00.736330 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:00.736295    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:06:00.836717 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:00.836689    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:06:00.937308 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:00.937222    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:06:01.037765 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.037727    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-7.ec2.internal\" not found"
Jul 31 00:06:01.041670 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.041653    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:01.068151 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.068117    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 00:06:01.068299 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.068274    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 00:06:01.068357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.068305    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 00:06:01.113437 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.113401    2582 apiserver.go:52] "Watching apiserver"
Jul 31 00:06:01.134653 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.134617    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 00:06:01.134774 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.134660    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"
Jul 31 00:06:01.135291 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.135272    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 00:06:01.135595 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.135578    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rqxgs","openshift-multus/network-metrics-daemon-z98bc","openshift-network-diagnostics/network-check-target-nn9bt","openshift-ovn-kubernetes/ovnkube-node-f8v42","kube-system/global-pull-secret-syncer-2cg9j","kube-system/konnectivity-agent-dl8tl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm","openshift-image-registry/node-ca-smd62","openshift-multus/multus-additional-cni-plugins-tgp6x","openshift-multus/multus-blw55","openshift-network-operator/iptables-alerter-vfxzv","openshift-cluster-node-tuning-operator/tuned-rbm2k"]
Jul 31 00:06:01.138147 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.138130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.140234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.140214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:01.140359 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.140312    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:01.140660 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.140642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nxwms\""
Jul 31 00:06:01.140757 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.140687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 00:06:01.140812 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.140685    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 00:06:01.142390 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.142375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:01.142442 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.142427    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:01.144571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.144556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.146696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.146679    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.146792 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.146723    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:01.147513 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.147306    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 00:06:01.147605 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.147558    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 00:06:01.147605 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.147562    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 00:06:01.147896 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.147879    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 00:06:01.147961 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.147910    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lmrn9\""
Jul 31 00:06:01.148066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.148050    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 00:06:01.148539 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.148520    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 00:06:01.148790 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.148757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 00:06:01.149733 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.149717    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.150104 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.150078    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 00:06:01.150232 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.150220    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"
Jul 31 00:06:01.151643 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.151613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.152285 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.152254    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 00:06:01.152285 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.152281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 00:06:01.152413 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.152392    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c2k8w\""
Jul 31 00:06:01.153927 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.153909    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.154166 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.154108    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 00:06:01.154262 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.154166    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 00:01:00 +0000 UTC" deadline="2028-04-04 22:26:36.272316496 +0000 UTC"
Jul 31 00:06:01.154262 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.154208    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14734h20m35.118112513s"
Jul 31 00:06:01.154375 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.154279    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 00:06:01.154375 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.154357    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jffn5\""
Jul 31 00:06:01.154536 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.154519    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 00:06:01.156200 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.156183    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.156602 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.156466    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 00:06:01.156728 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.156615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 00:06:01.156728 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.156619    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 00:06:01.156850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.156803    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-26w5c\""
Jul 31 00:06:01.156850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.156841    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 00:06:01.158561 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.158543    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.158989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.158970    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 00:06:01.158989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.158982    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r7hsc\""
Jul 31 00:06:01.159147 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.158975    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 00:06:01.159147 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.159090    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 00:06:01.159249 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.159242    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 00:06:01.159301 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.159260    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 00:06:01.160893 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.160877    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 00:06:01.161034 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.161023    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wxx7z\""
Jul 31 00:06:01.161116 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.161103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.163619 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.163599    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal"]
Jul 31 00:06:01.163713 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.163644    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal"]
Jul 31 00:06:01.163713 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.163693    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.163919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.163901    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 00:06:01.164001 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.163943    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:06:01.164089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.164076    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 00:06:01.164153 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.164141    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5znz2\""
Jul 31 00:06:01.166033 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.166004    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:06:01.166239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.166226    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jnpvm\""
Jul 31 00:06:01.166296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.166242    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 00:06:01.168726 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.168704    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgwhw"
Jul 31 00:06:01.176250 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.176229    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zgwhw"
Jul 31 00:06:01.236766 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.236739    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 00:06:01.241837 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:01.241986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-kubelet\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.241986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-cni-netd\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.241986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-socket-dir-parent\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.241986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-conf-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.241986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-socket-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.241986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241969    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-systemd\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.241992    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-os-release\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-hostroot\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242041    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-modprobe-d\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flc5p\" (UniqueName: \"kubernetes.io/projected/95d8d6a7-a733-4c80-8468-d3d27639d962-kube-api-access-flc5p\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242085    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/230af5e7-ff0d-4419-81ef-091cd8219ad9-dbus\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cnibin\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.242196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8wz2\" (UniqueName: \"kubernetes.io/projected/f8f30044-ba08-48b7-a77d-260989114bff-kube-api-access-j8wz2\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5a03a19-9f05-4a1b-9203-93c05f371a16-konnectivity-ca\") pod \"konnectivity-agent-dl8tl\" (UID: \"c5a03a19-9f05-4a1b-9203-93c05f371a16\") " pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efe2d439-2ef6-4a94-87fb-841d5be15612-host\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-var-lib-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx48l\" (UniqueName: \"kubernetes.io/projected/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-kube-api-access-cx48l\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-cni-multus\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242312    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bkz5\" (UniqueName: \"kubernetes.io/projected/8cb26569-0546-4cc8-8ee6-8087e8d210de-kube-api-access-6bkz5\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-host\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-system-cni-dir\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-os-release\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysconfig\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-system-cni-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95d8d6a7-a733-4c80-8468-d3d27639d962-hosts-file\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95d8d6a7-a733-4c80-8468-d3d27639d962-tmp-dir\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-run-netns\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-node-log\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.242704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcda3902-c297-4dca-912b-7aac26853a2f-cni-binary-copy\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-k8s-cni-cncf-io\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-netns\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-registration-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljq5\" (UniqueName: \"kubernetes.io/projected/e516194c-eccc-4ff0-8d23-9f147554bbaf-kube-api-access-4ljq5\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrssm\" (UniqueName: \"kubernetes.io/projected/fcda3902-c297-4dca-912b-7aac26853a2f-kube-api-access-mrssm\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysctl-conf\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-systemd\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-var-lib-kubelet\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-systemd-units\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovnkube-script-lib\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.242968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbfz\" (UniqueName: \"kubernetes.io/projected/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-kube-api-access-wbbfz\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-multus-certs\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-sys\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.243363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-slash\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243117    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-etc-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-kubelet\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243179    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f30044-ba08-48b7-a77d-260989114bff-tmp\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-ovn\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243241    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcda3902-c297-4dca-912b-7aac26853a2f-multus-daemon-config\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysctl-d\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-cni-bin\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-kubernetes\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/230af5e7-ff0d-4419-81ef-091cd8219ad9-kubelet-config\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-sys-fs\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243469    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/efe2d439-2ef6-4a94-87fb-841d5be15612-serviceca\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-cni-bin\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-cni-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cb26569-0546-4cc8-8ee6-8087e8d210de-iptables-alerter-script\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.243996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8f30044-ba08-48b7-a77d-260989114bff-etc-tuned\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-device-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-cnibin\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-etc-kubernetes\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxdzj\" (UniqueName: \"kubernetes.io/projected/efe2d439-2ef6-4a94-87fb-841d5be15612-kube-api-access-pxdzj\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovnkube-config\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-lib-modules\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfpkw\" (UniqueName: \"kubernetes.io/projected/29ae0441-1a78-4692-97ad-a2749a174cd3-kube-api-access-dfpkw\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-log-socket\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.243986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.244000    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-env-overrides\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.244014    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5a03a19-9f05-4a1b-9203-93c05f371a16-agent-certs\") pod \"konnectivity-agent-dl8tl\" (UID: \"c5a03a19-9f05-4a1b-9203-93c05f371a16\") " pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.244745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.244054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.245274 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.244075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cb26569-0546-4cc8-8ee6-8087e8d210de-host-slash\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.245274 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.244101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-run\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.345037 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysconfig\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.345037 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-system-cni-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95d8d6a7-a733-4c80-8468-d3d27639d962-hosts-file\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95d8d6a7-a733-4c80-8468-d3d27639d962-tmp-dir\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-run-netns\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-node-log\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysconfig\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcda3902-c297-4dca-912b-7aac26853a2f-cni-binary-copy\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-k8s-cni-cncf-io\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345158    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95d8d6a7-a733-4c80-8468-d3d27639d962-hosts-file\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-netns\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-run-netns\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345165    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-system-cni-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-node-log\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-k8s-cni-cncf-io\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-netns\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-registration-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljq5\" (UniqueName: \"kubernetes.io/projected/e516194c-eccc-4ff0-8d23-9f147554bbaf-kube-api-access-4ljq5\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.345332 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrssm\" (UniqueName: \"kubernetes.io/projected/fcda3902-c297-4dca-912b-7aac26853a2f-kube-api-access-mrssm\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysctl-conf\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-systemd\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-var-lib-kubelet\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-registration-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-systemd-units\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovnkube-script-lib\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345464    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-systemd\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbfz\" (UniqueName: \"kubernetes.io/projected/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-kube-api-access-wbbfz\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-multus-certs\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-var-lib-kubelet\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-sys\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-slash\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-systemd-units\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-etc-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95d8d6a7-a733-4c80-8468-d3d27639d962-tmp-dir\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.346183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-kubelet\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345649    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysctl-conf\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f30044-ba08-48b7-a77d-260989114bff-tmp\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-ovn\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345704    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcda3902-c297-4dca-912b-7aac26853a2f-multus-daemon-config\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysctl-d\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-etc-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcda3902-c297-4dca-912b-7aac26853a2f-cni-binary-copy\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345879    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-sysctl-d\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-cni-bin\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345921    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-ovn\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345950    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-cni-bin\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-kubelet\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.345993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-run-multus-certs\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-slash\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.346983 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-sys\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-kubernetes\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovnkube-script-lib\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/230af5e7-ff0d-4419-81ef-091cd8219ad9-kubelet-config\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-sys-fs\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/efe2d439-2ef6-4a94-87fb-841d5be15612-serviceca\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-cni-bin\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-sys-fs\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-kubernetes\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/230af5e7-ff0d-4419-81ef-091cd8219ad9-kubelet-config\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346234    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-cni-bin\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-cni-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cb26569-0546-4cc8-8ee6-8087e8d210de-iptables-alerter-script\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8f30044-ba08-48b7-a77d-260989114bff-etc-tuned\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.347770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-device-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346368    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcda3902-c297-4dca-912b-7aac26853a2f-multus-daemon-config\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-cnibin\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-cnibin\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-etc-kubernetes\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-device-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-cni-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-etc-kubernetes\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxdzj\" (UniqueName: \"kubernetes.io/projected/efe2d439-2ef6-4a94-87fb-841d5be15612-kube-api-access-pxdzj\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovnkube-config\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-lib-modules\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfpkw\" (UniqueName: \"kubernetes.io/projected/29ae0441-1a78-4692-97ad-a2749a174cd3-kube-api-access-dfpkw\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.346573    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/efe2d439-2ef6-4a94-87fb-841d5be15612-serviceca\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.348505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.346669    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret podName:230af5e7-ff0d-4419-81ef-091cd8219ad9 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:01.846641794 +0000 UTC m=+2.123884775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret") pod "global-pull-secret-syncer-2cg9j" (UID: "230af5e7-ff0d-4419-81ef-091cd8219ad9") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-log-socket\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-env-overrides\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346777    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-lib-modules\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5a03a19-9f05-4a1b-9203-93c05f371a16-agent-certs\") pod \"konnectivity-agent-dl8tl\" (UID: \"c5a03a19-9f05-4a1b-9203-93c05f371a16\") " pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.346850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cb26569-0546-4cc8-8ee6-8087e8d210de-host-slash\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.347351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-run\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.347410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-log-socket\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.347300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-run\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.347459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.347952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-env-overrides\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cb26569-0546-4cc8-8ee6-8087e8d210de-iptables-alerter-script\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.349349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cb26569-0546-4cc8-8ee6-8087e8d210de-host-slash\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-kubelet\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-cni-netd\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-socket-dir-parent\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-conf-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-socket-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-systemd\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.348990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-kubelet\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-os-release\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-hostroot\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-modprobe-d\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349065    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovnkube-config\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flc5p\" (UniqueName: \"kubernetes.io/projected/95d8d6a7-a733-4c80-8468-d3d27639d962-kube-api-access-flc5p\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.349114    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:01.350098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-run-systemd\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.349196    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:01.849169619 +0000 UTC m=+2.126412587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/230af5e7-ff0d-4419-81ef-091cd8219ad9-dbus\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349267    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-socket-dir-parent\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cnibin\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cnibin\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8wz2\" (UniqueName: \"kubernetes.io/projected/f8f30044-ba08-48b7-a77d-260989114bff-kube-api-access-j8wz2\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-host-cni-netd\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5a03a19-9f05-4a1b-9203-93c05f371a16-konnectivity-ca\") pod \"konnectivity-agent-dl8tl\" (UID: \"c5a03a19-9f05-4a1b-9203-93c05f371a16\") " pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/230af5e7-ff0d-4419-81ef-091cd8219ad9-dbus\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efe2d439-2ef6-4a94-87fb-841d5be15612-host\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-var-lib-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-os-release\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx48l\" (UniqueName: \"kubernetes.io/projected/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-kube-api-access-cx48l\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-cni-multus\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.350936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bkz5\" (UniqueName: \"kubernetes.io/projected/8cb26569-0546-4cc8-8ee6-8087e8d210de-kube-api-access-6bkz5\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-host\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-system-cni-dir\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e516194c-eccc-4ff0-8d23-9f147554bbaf-socket-dir\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-os-release\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349754    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-multus-conf-dir\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-var-lib-openvswitch\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.349979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f8f30044-ba08-48b7-a77d-260989114bff-etc-tuned\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-hostroot\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-etc-modprobe-d\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350077    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-system-cni-dir\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350142    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f30044-ba08-48b7-a77d-260989114bff-host\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/efe2d439-2ef6-4a94-87fb-841d5be15612-host\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-host-var-lib-cni-multus\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f30044-ba08-48b7-a77d-260989114bff-tmp\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcda3902-c297-4dca-912b-7aac26853a2f-os-release\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.350827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.351671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.351250    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5a03a19-9f05-4a1b-9203-93c05f371a16-konnectivity-ca\") pod \"konnectivity-agent-dl8tl\" (UID: \"c5a03a19-9f05-4a1b-9203-93c05f371a16\") " pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.352877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.352828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.353458 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.353434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.353603 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.353530    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5a03a19-9f05-4a1b-9203-93c05f371a16-agent-certs\") pod \"konnectivity-agent-dl8tl\" (UID: \"c5a03a19-9f05-4a1b-9203-93c05f371a16\") " pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.356057 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.356034    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:01.356187 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.356175    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:01.356291 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.356274    2582 projected.go:196] Error preparing data for projected volume kube-api-access-hwppv for pod openshift-network-diagnostics/network-check-target-nn9bt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:01.356439 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.356426    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv podName:7225ffa0-ba97-41e9-81fc-58db5c697506 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:01.856405169 +0000 UTC m=+2.133648139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hwppv" (UniqueName: "kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv") pod "network-check-target-nn9bt" (UID: "7225ffa0-ba97-41e9-81fc-58db5c697506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:01.357093 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.356872    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbfz\" (UniqueName: \"kubernetes.io/projected/a0dc9845-9e58-4a6e-816a-60c3ddb915fc-kube-api-access-wbbfz\") pod \"multus-additional-cni-plugins-tgp6x\" (UID: \"a0dc9845-9e58-4a6e-816a-60c3ddb915fc\") " pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.357918 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.357847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljq5\" (UniqueName: \"kubernetes.io/projected/e516194c-eccc-4ff0-8d23-9f147554bbaf-kube-api-access-4ljq5\") pod \"aws-ebs-csi-driver-node-dfrzm\" (UID: \"e516194c-eccc-4ff0-8d23-9f147554bbaf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.358004 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.357954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfpkw\" (UniqueName: \"kubernetes.io/projected/29ae0441-1a78-4692-97ad-a2749a174cd3-kube-api-access-dfpkw\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:01.358070 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.358024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flc5p\" (UniqueName: \"kubernetes.io/projected/95d8d6a7-a733-4c80-8468-d3d27639d962-kube-api-access-flc5p\") pod \"node-resolver-rqxgs\" (UID: \"95d8d6a7-a733-4c80-8468-d3d27639d962\") " pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.358747 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.358724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bkz5\" (UniqueName: \"kubernetes.io/projected/8cb26569-0546-4cc8-8ee6-8087e8d210de-kube-api-access-6bkz5\") pod \"iptables-alerter-vfxzv\" (UID: \"8cb26569-0546-4cc8-8ee6-8087e8d210de\") " pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.359088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.359068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx48l\" (UniqueName: \"kubernetes.io/projected/34a4c6a5-75f1-4516-bc55-374e81a2d2aa-kube-api-access-cx48l\") pod \"ovnkube-node-f8v42\" (UID: \"34a4c6a5-75f1-4516-bc55-374e81a2d2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.359386 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.359365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxdzj\" (UniqueName: \"kubernetes.io/projected/efe2d439-2ef6-4a94-87fb-841d5be15612-kube-api-access-pxdzj\") pod \"node-ca-smd62\" (UID: \"efe2d439-2ef6-4a94-87fb-841d5be15612\") " pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.359602 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.359585    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrssm\" (UniqueName: \"kubernetes.io/projected/fcda3902-c297-4dca-912b-7aac26853a2f-kube-api-access-mrssm\") pod \"multus-blw55\" (UID: \"fcda3902-c297-4dca-912b-7aac26853a2f\") " pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.359950 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.359933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8wz2\" (UniqueName: \"kubernetes.io/projected/f8f30044-ba08-48b7-a77d-260989114bff-kube-api-access-j8wz2\") pod \"tuned-rbm2k\" (UID: \"f8f30044-ba08-48b7-a77d-260989114bff\") " pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.412761 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.412722    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a70a09f2dffef1bbceb86aac02062a.slice/crio-b17de68733ffce664ac723f4e1e85977fe114aa8cdcb03547d1dd5a935d5e38c WatchSource:0}: Error finding container b17de68733ffce664ac723f4e1e85977fe114aa8cdcb03547d1dd5a935d5e38c: Status 404 returned error can't find the container with id b17de68733ffce664ac723f4e1e85977fe114aa8cdcb03547d1dd5a935d5e38c
Jul 31 00:06:01.413077 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.413063    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7884b403dc3402323142f0de6f6cf966.slice/crio-9f78356587ba915269b2c919d8ecf9dbfd8d7078a6071ce1a3820b8605d38198 WatchSource:0}: Error finding container 9f78356587ba915269b2c919d8ecf9dbfd8d7078a6071ce1a3820b8605d38198: Status 404 returned error can't find the container with id 9f78356587ba915269b2c919d8ecf9dbfd8d7078a6071ce1a3820b8605d38198
Jul 31 00:06:01.417087 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.417069    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:06:01.461494 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.461397    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqxgs"
Jul 31 00:06:01.471765 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.471729    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d8d6a7_a733_4c80_8468_d3d27639d962.slice/crio-2810a4c339d6cc96bdd2f349b543ee7193df2a56f98be20700e0e6c3fd050b5f WatchSource:0}: Error finding container 2810a4c339d6cc96bdd2f349b543ee7193df2a56f98be20700e0e6c3fd050b5f: Status 404 returned error can't find the container with id 2810a4c339d6cc96bdd2f349b543ee7193df2a56f98be20700e0e6c3fd050b5f
Jul 31 00:06:01.490285 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.490257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:01.498954 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.498930    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a4c6a5_75f1_4516_bc55_374e81a2d2aa.slice/crio-1dd26ca3ae64a5d647edc366617505d1d270f9fd51c4ff999994afa192408eab WatchSource:0}: Error finding container 1dd26ca3ae64a5d647edc366617505d1d270f9fd51c4ff999994afa192408eab: Status 404 returned error can't find the container with id 1dd26ca3ae64a5d647edc366617505d1d270f9fd51c4ff999994afa192408eab
Jul 31 00:06:01.505341 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.505317    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:01.509774 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.509753    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:01.513867 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.513842    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a03a19_9f05_4a1b_9203_93c05f371a16.slice/crio-e067539317ee38a902626afb64cc9ff367e33a331ac7dee03feed87aa689b493 WatchSource:0}: Error finding container e067539317ee38a902626afb64cc9ff367e33a331ac7dee03feed87aa689b493: Status 404 returned error can't find the container with id e067539317ee38a902626afb64cc9ff367e33a331ac7dee03feed87aa689b493
Jul 31 00:06:01.521108 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.521086    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm"
Jul 31 00:06:01.529166 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.529133    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode516194c_eccc_4ff0_8d23_9f147554bbaf.slice/crio-12a2837fc69b67f08680350255b849664fb547988663b3bdc3eacc287e36efb6 WatchSource:0}: Error finding container 12a2837fc69b67f08680350255b849664fb547988663b3bdc3eacc287e36efb6: Status 404 returned error can't find the container with id 12a2837fc69b67f08680350255b849664fb547988663b3bdc3eacc287e36efb6
Jul 31 00:06:01.538151 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.538130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smd62"
Jul 31 00:06:01.546296 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.546271    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe2d439_2ef6_4a94_87fb_841d5be15612.slice/crio-07eaa4edaa63df33df8712cc600bde81e7a7347682f9b9d1431811cf0da31581 WatchSource:0}: Error finding container 07eaa4edaa63df33df8712cc600bde81e7a7347682f9b9d1431811cf0da31581: Status 404 returned error can't find the container with id 07eaa4edaa63df33df8712cc600bde81e7a7347682f9b9d1431811cf0da31581
Jul 31 00:06:01.549252 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.549235    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgp6x"
Jul 31 00:06:01.557432 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.557405    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0dc9845_9e58_4a6e_816a_60c3ddb915fc.slice/crio-7098f228940d9564b1920d2c0ff968a61e2ad9f25ae159f5513aa5c610522735 WatchSource:0}: Error finding container 7098f228940d9564b1920d2c0ff968a61e2ad9f25ae159f5513aa5c610522735: Status 404 returned error can't find the container with id 7098f228940d9564b1920d2c0ff968a61e2ad9f25ae159f5513aa5c610522735
Jul 31 00:06:01.571582 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.571559    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:01.587802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.587774    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-blw55"
Jul 31 00:06:01.596605 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.596582    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcda3902_c297_4dca_912b_7aac26853a2f.slice/crio-a4740abfb8e77c466456f9483acd20fe950fd0d8cfa245fa6fbb6ab4bebcc7a4 WatchSource:0}: Error finding container a4740abfb8e77c466456f9483acd20fe950fd0d8cfa245fa6fbb6ab4bebcc7a4: Status 404 returned error can't find the container with id a4740abfb8e77c466456f9483acd20fe950fd0d8cfa245fa6fbb6ab4bebcc7a4
Jul 31 00:06:01.602477 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.602459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vfxzv"
Jul 31 00:06:01.608181 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.608163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rbm2k"
Jul 31 00:06:01.611345 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.611208    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb26569_0546_4cc8_8ee6_8087e8d210de.slice/crio-63b747f02a2ea136bfecb91faec248157f56e281e0d84ca86f89f42cace13bf4 WatchSource:0}: Error finding container 63b747f02a2ea136bfecb91faec248157f56e281e0d84ca86f89f42cace13bf4: Status 404 returned error can't find the container with id 63b747f02a2ea136bfecb91faec248157f56e281e0d84ca86f89f42cace13bf4
Jul 31 00:06:01.616953 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:01.616931    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f30044_ba08_48b7_a77d_260989114bff.slice/crio-1fd539a3fb6fe01409e4fe725822189248072470ffc99574395766e26539a5ad WatchSource:0}: Error finding container 1fd539a3fb6fe01409e4fe725822189248072470ffc99574395766e26539a5ad: Status 404 returned error can't find the container with id 1fd539a3fb6fe01409e4fe725822189248072470ffc99574395766e26539a5ad
Jul 31 00:06:01.853589 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.853553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:01.853805 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.853606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:01.853805 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.853707    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:01.853805 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.853732    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:01.853805 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.853766    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret podName:230af5e7-ff0d-4419-81ef-091cd8219ad9 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:02.853752148 +0000 UTC m=+3.130995115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret") pod "global-pull-secret-syncer-2cg9j" (UID: "230af5e7-ff0d-4419-81ef-091cd8219ad9") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:01.853805 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.853780    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:02.85377409 +0000 UTC m=+3.131017057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:01.954584 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:01.954548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:01.954769 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.954683    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:01.954769 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.954699    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:01.954769 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.954708    2582 projected.go:196] Error preparing data for projected volume kube-api-access-hwppv for pod openshift-network-diagnostics/network-check-target-nn9bt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:01.954769 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:01.954754    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv podName:7225ffa0-ba97-41e9-81fc-58db5c697506 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:02.95474184 +0000 UTC m=+3.231984812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwppv" (UniqueName: "kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv") pod "network-check-target-nn9bt" (UID: "7225ffa0-ba97-41e9-81fc-58db5c697506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:02.118712 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.118330    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:02.179227 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.179102    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 00:01:01 +0000 UTC" deadline="2028-04-10 04:31:26.918040896 +0000 UTC"
Jul 31 00:06:02.179227 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.179166    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14860h25m24.738878901s"
Jul 31 00:06:02.245162 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.244553    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:02.245162 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.244713    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:02.249384 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.249276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal" event={"ID":"13a70a09f2dffef1bbceb86aac02062a","Type":"ContainerStarted","Data":"b17de68733ffce664ac723f4e1e85977fe114aa8cdcb03547d1dd5a935d5e38c"}
Jul 31 00:06:02.251829 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.251743    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vfxzv" event={"ID":"8cb26569-0546-4cc8-8ee6-8087e8d210de","Type":"ContainerStarted","Data":"63b747f02a2ea136bfecb91faec248157f56e281e0d84ca86f89f42cace13bf4"}
Jul 31 00:06:02.255181 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.255091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerStarted","Data":"7098f228940d9564b1920d2c0ff968a61e2ad9f25ae159f5513aa5c610522735"}
Jul 31 00:06:02.258219 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.258130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smd62" event={"ID":"efe2d439-2ef6-4a94-87fb-841d5be15612","Type":"ContainerStarted","Data":"07eaa4edaa63df33df8712cc600bde81e7a7347682f9b9d1431811cf0da31581"}
Jul 31 00:06:02.263913 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.263793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqxgs" event={"ID":"95d8d6a7-a733-4c80-8468-d3d27639d962","Type":"ContainerStarted","Data":"2810a4c339d6cc96bdd2f349b543ee7193df2a56f98be20700e0e6c3fd050b5f"}
Jul 31 00:06:02.278229 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.278124    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" event={"ID":"7884b403dc3402323142f0de6f6cf966","Type":"ContainerStarted","Data":"9f78356587ba915269b2c919d8ecf9dbfd8d7078a6071ce1a3820b8605d38198"}
Jul 31 00:06:02.286111 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.286075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rbm2k" event={"ID":"f8f30044-ba08-48b7-a77d-260989114bff","Type":"ContainerStarted","Data":"1fd539a3fb6fe01409e4fe725822189248072470ffc99574395766e26539a5ad"}
Jul 31 00:06:02.289468 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.289435    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blw55" event={"ID":"fcda3902-c297-4dca-912b-7aac26853a2f","Type":"ContainerStarted","Data":"a4740abfb8e77c466456f9483acd20fe950fd0d8cfa245fa6fbb6ab4bebcc7a4"}
Jul 31 00:06:02.295254 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.295216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm" event={"ID":"e516194c-eccc-4ff0-8d23-9f147554bbaf","Type":"ContainerStarted","Data":"12a2837fc69b67f08680350255b849664fb547988663b3bdc3eacc287e36efb6"}
Jul 31 00:06:02.297844 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.297811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dl8tl" event={"ID":"c5a03a19-9f05-4a1b-9203-93c05f371a16","Type":"ContainerStarted","Data":"e067539317ee38a902626afb64cc9ff367e33a331ac7dee03feed87aa689b493"}
Jul 31 00:06:02.300518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.300491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"1dd26ca3ae64a5d647edc366617505d1d270f9fd51c4ff999994afa192408eab"}
Jul 31 00:06:02.861414 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.861250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:02.861414 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.861314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:02.861723 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.861436    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:02.861723 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.861489    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:04.861473431 +0000 UTC m=+5.138716398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:02.861840 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.861735    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:02.861840 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.861784    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret podName:230af5e7-ff0d-4419-81ef-091cd8219ad9 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:04.86176963 +0000 UTC m=+5.139012600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret") pod "global-pull-secret-syncer-2cg9j" (UID: "230af5e7-ff0d-4419-81ef-091cd8219ad9") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:02.864457 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.864113    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 00:06:02.962377 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:02.962337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:02.968200 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.967909    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:02.968200 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.967944    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:02.968200 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.967966    2582 projected.go:196] Error preparing data for projected volume kube-api-access-hwppv for pod openshift-network-diagnostics/network-check-target-nn9bt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:02.968200 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:02.968051    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv podName:7225ffa0-ba97-41e9-81fc-58db5c697506 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:04.968023037 +0000 UTC m=+5.245266007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwppv" (UniqueName: "kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv") pod "network-check-target-nn9bt" (UID: "7225ffa0-ba97-41e9-81fc-58db5c697506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:03.179786 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:03.179559    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 00:01:01 +0000 UTC" deadline="2028-01-10 11:10:43.81229984 +0000 UTC"
Jul 31 00:06:03.179786 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:03.179636    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12683h4m40.6326818s"
Jul 31 00:06:03.241856 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:03.241813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:03.242046 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:03.241945    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:03.242461 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:03.242344    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:03.242461 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:03.242438    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:04.245034 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:04.244828    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:04.245034 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.244978    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:04.879412 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:04.879372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:04.879610 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:04.879442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:04.879610 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.879594    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:04.879748 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.879640    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:04.879748 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.879672    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:08.879653797 +0000 UTC m=+9.156896766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:04.879748 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.879705    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret podName:230af5e7-ff0d-4419-81ef-091cd8219ad9 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:08.87968674 +0000 UTC m=+9.156929714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret") pod "global-pull-secret-syncer-2cg9j" (UID: "230af5e7-ff0d-4419-81ef-091cd8219ad9") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:04.980561 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:04.979946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:04.980561 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.980147    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:04.980561 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.980169    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:04.980561 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.980181    2582 projected.go:196] Error preparing data for projected volume kube-api-access-hwppv for pod openshift-network-diagnostics/network-check-target-nn9bt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:04.980561 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:04.980234    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv podName:7225ffa0-ba97-41e9-81fc-58db5c697506 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:08.980216185 +0000 UTC m=+9.257459155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwppv" (UniqueName: "kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv") pod "network-check-target-nn9bt" (UID: "7225ffa0-ba97-41e9-81fc-58db5c697506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:05.242399 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:05.242317    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:05.242399 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:05.242330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:05.242681 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:05.242473    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:05.242681 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:05.242520    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:06.242003 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:06.241826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:06.242003 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:06.241994    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:07.242351 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:07.242314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:07.242797 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:07.242314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:07.242797 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:07.242452    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:07.242797 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:07.242551    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:08.242306 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:08.242268    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:08.242508 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:08.242414    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:08.912494 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:08.912450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:08.912715 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:08.912528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:08.912804 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:08.912715    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:08.912804 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:08.912783    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:16.91276307 +0000 UTC m=+17.190006038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:08.913223 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:08.913183    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:08.913347 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:08.913240    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret podName:230af5e7-ff0d-4419-81ef-091cd8219ad9 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:16.91322513 +0000 UTC m=+17.190468110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret") pod "global-pull-secret-syncer-2cg9j" (UID: "230af5e7-ff0d-4419-81ef-091cd8219ad9") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:09.013727 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:09.013685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:09.013929 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:09.013848    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:09.013929 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:09.013869    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:09.013929 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:09.013881    2582 projected.go:196] Error preparing data for projected volume kube-api-access-hwppv for pod openshift-network-diagnostics/network-check-target-nn9bt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:09.014082 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:09.013945    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv podName:7225ffa0-ba97-41e9-81fc-58db5c697506 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:17.013926958 +0000 UTC m=+17.291169938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwppv" (UniqueName: "kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv") pod "network-check-target-nn9bt" (UID: "7225ffa0-ba97-41e9-81fc-58db5c697506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:09.242416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:09.242327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:09.242416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:09.242382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:09.243000 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:09.242464    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:09.243000 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:09.242603    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:10.243427 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:10.243392    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:10.243928 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:10.243512    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:11.242850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:11.242605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:11.242850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:11.242666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:11.242850 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:11.242760    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:11.243212 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:11.242957    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:12.242639 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:12.242591    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:12.243099 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:12.242775    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:13.242533 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:13.242508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:13.242615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:13.242547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:13.242665 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:13.242637    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:13.242934 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:13.242736    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:14.242498 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:14.242251    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:14.242698 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:14.242635    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:15.242681 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:15.242647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:15.242866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:15.242647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:15.242866 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:15.242776    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:15.243212 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:15.242858    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:16.255714 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:16.255679    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:16.256141 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:16.255813    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:16.978602 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:16.978563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:16.978782 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:16.978618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:16.978782 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:16.978727    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:16.978782 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:16.978732    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:16.978782 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:16.978781    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:32.978765627 +0000 UTC m=+33.256008594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:16.978919 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:16.978794    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret podName:230af5e7-ff0d-4419-81ef-091cd8219ad9 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:32.978788073 +0000 UTC m=+33.256031039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret") pod "global-pull-secret-syncer-2cg9j" (UID: "230af5e7-ff0d-4419-81ef-091cd8219ad9") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:17.079862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:17.079825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:17.080005 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:17.079961    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:17.080005 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:17.079974    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:17.080005 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:17.079983    2582 projected.go:196] Error preparing data for projected volume kube-api-access-hwppv for pod openshift-network-diagnostics/network-check-target-nn9bt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:17.080116 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:17.080029    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv podName:7225ffa0-ba97-41e9-81fc-58db5c697506 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:33.080016196 +0000 UTC m=+33.357259162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwppv" (UniqueName: "kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv") pod "network-check-target-nn9bt" (UID: "7225ffa0-ba97-41e9-81fc-58db5c697506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:17.241928 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:17.241850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:17.242058 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:17.241850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:17.242058 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:17.241962    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:17.242058 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:17.242021    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:18.242161 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:18.242124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:18.242592 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:18.242248    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:19.242210 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:19.242173    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:19.242210 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:19.242213    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:19.242688 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:19.242313    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:19.242688 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:19.242446    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:20.243061 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:20.243021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:20.243487 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:20.243160    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:21.242310 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:21.242276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:21.242459 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:21.242319    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:21.242459 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:21.242384    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:21.242541 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:21.242487    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:22.242767 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.242545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:22.243544 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:22.242862    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:22.356308 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.355940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rbm2k" event={"ID":"f8f30044-ba08-48b7-a77d-260989114bff","Type":"ContainerStarted","Data":"1ab3a661726d80f3f0bc5bb2de8d26c1dbaac398a5edd5258ff3a715bc938ca2"}
Jul 31 00:06:22.357695 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.357659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-blw55" event={"ID":"fcda3902-c297-4dca-912b-7aac26853a2f","Type":"ContainerStarted","Data":"58a3aa3f4556c23c666788c8a9007809f33b57aa9138e64824c784f9da186125"}
Jul 31 00:06:22.359239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.359171    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm" event={"ID":"e516194c-eccc-4ff0-8d23-9f147554bbaf","Type":"ContainerStarted","Data":"afee7f38748a78ef7e06c834b7ab49d7d8e8d73a4f586d740134f5b35b83447d"}
Jul 31 00:06:22.360826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.360797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dl8tl" event={"ID":"c5a03a19-9f05-4a1b-9203-93c05f371a16","Type":"ContainerStarted","Data":"835d75f271618d27593d516843b72225637d97dd615fd9e3dc94cbbd8a7bf367"}
Jul 31 00:06:22.363740 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.363721    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:06:22.364068 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.364042    2582 generic.go:356] "Generic (PLEG): container finished" podID="34a4c6a5-75f1-4516-bc55-374e81a2d2aa" containerID="38dfb92665531cb50e89b438dced08c5f45bd90b35a4be2450a967c349865582" exitCode=1
Jul 31 00:06:22.364140 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.364101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"b05f266a9f5238a641c4efc441425b286fff7700fc78ae4322ff5ce53f9d26fd"}
Jul 31 00:06:22.364184 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.364172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"e25ab5fe132d29e4767c6aac47e7e2f718f9aa70200934de57c49f753315f7a9"}
Jul 31 00:06:22.364238 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.364223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"ff796d285971c470d90de32d71fece488edf3ff05fc176ef66fa52408ad88062"}
Jul 31 00:06:22.364289 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.364275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerDied","Data":"38dfb92665531cb50e89b438dced08c5f45bd90b35a4be2450a967c349865582"}
Jul 31 00:06:22.364353 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.364325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"483018115e948598cb97a7492f0919600d3441e8228c6a626b185278e5228d1e"}
Jul 31 00:06:22.365615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.365593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal" event={"ID":"13a70a09f2dffef1bbceb86aac02062a","Type":"ContainerStarted","Data":"b039719ce540a90ed1b553a0dc54505fd92a598d4a7f91649b270e3c87254435"}
Jul 31 00:06:22.366996 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.366974    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0dc9845-9e58-4a6e-816a-60c3ddb915fc" containerID="02ef75a3660285b60f28d0fdcc1721ad99c49b9ccd961ab6fd1c12f3f0da29b4" exitCode=0
Jul 31 00:06:22.367087 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.367047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerDied","Data":"02ef75a3660285b60f28d0fdcc1721ad99c49b9ccd961ab6fd1c12f3f0da29b4"}
Jul 31 00:06:22.368416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.368388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smd62" event={"ID":"efe2d439-2ef6-4a94-87fb-841d5be15612","Type":"ContainerStarted","Data":"65b6e5c8eb480b83b1022bb6aefb20466c9561fe121a46d7e707e0711678740d"}
Jul 31 00:06:22.369846 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.369825    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqxgs" event={"ID":"95d8d6a7-a733-4c80-8468-d3d27639d962","Type":"ContainerStarted","Data":"5b7303cc9726dbdd447b09f43c674269719d0eaa9512bdd157e34df8e3f1e25e"}
Jul 31 00:06:22.371322 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.371298    2582 generic.go:356] "Generic (PLEG): container finished" podID="7884b403dc3402323142f0de6f6cf966" containerID="fcf8dff39358d21f168943194e1c3c0aa4d06dad5c866d6e3f7dfbf72f24fba8" exitCode=0
Jul 31 00:06:22.371406 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.371333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" event={"ID":"7884b403dc3402323142f0de6f6cf966","Type":"ContainerDied","Data":"fcf8dff39358d21f168943194e1c3c0aa4d06dad5c866d6e3f7dfbf72f24fba8"}
Jul 31 00:06:22.387773 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.387703    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-blw55" podStartSLOduration=2.257995982 podStartE2EDuration="22.387681269s" totalImagesPullingTime="20.129685287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:22.386995932 +0000 UTC m=+22.664238920" watchObservedRunningTime="2026-07-31 00:06:22.387681269 +0000 UTC m=+22.664924259"
Jul 31 00:06:22.387954 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.387928    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rbm2k" podStartSLOduration=2.65132025 podStartE2EDuration="22.387920226s" totalImagesPullingTime="19.736599976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:22.372142724 +0000 UTC m=+22.649385713" watchObservedRunningTime="2026-07-31 00:06:22.387920226 +0000 UTC m=+22.665163220"
Jul 31 00:06:22.430100 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.429508    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dl8tl" podStartSLOduration=10.691016078 podStartE2EDuration="22.429492519s" totalImagesPullingTime="11.738476441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:22.42918937 +0000 UTC m=+22.706432359" watchObservedRunningTime="2026-07-31 00:06:22.429492519 +0000 UTC m=+22.706735509"
Jul 31 00:06:22.459753 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.459276    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-smd62" podStartSLOduration=2.652982552 podStartE2EDuration="22.459255703s" totalImagesPullingTime="19.806273151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:22.459166739 +0000 UTC m=+22.736409728" watchObservedRunningTime="2026-07-31 00:06:22.459255703 +0000 UTC m=+22.736498693"
Jul 31 00:06:22.510436 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.510384    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.ec2.internal" podStartSLOduration=21.510368612 podStartE2EDuration="21.510368612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:22.509837096 +0000 UTC m=+22.787080085" watchObservedRunningTime="2026-07-31 00:06:22.510368612 +0000 UTC m=+22.787611602"
Jul 31 00:06:22.529986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:22.529928    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rqxgs" podStartSLOduration=2.649120396 podStartE2EDuration="22.529905976s" totalImagesPullingTime="19.88078558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:22.529213721 +0000 UTC m=+22.806456712" watchObservedRunningTime="2026-07-31 00:06:22.529905976 +0000 UTC m=+22.807148966"
Jul 31 00:06:23.242488 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.242405    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:23.242725 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.242405    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:23.242725 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:23.242556    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:23.242725 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:23.242636    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:23.377391 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.377360    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:06:23.377855 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.377823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"7f919c289ac1aff2403c10b32d0f2bb6c2f4e12b5474717fe012fa7ccc769f1b"}
Jul 31 00:06:23.379426 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.379400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vfxzv" event={"ID":"8cb26569-0546-4cc8-8ee6-8087e8d210de","Type":"ContainerStarted","Data":"dabf7e558229776545f4e5e178a5b5a458d0c24e66e882eeb3795d19cb29d0ea"}
Jul 31 00:06:23.381489 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.381423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" event={"ID":"7884b403dc3402323142f0de6f6cf966","Type":"ContainerStarted","Data":"0a811cfbcbf6a3df43b956f77fbf72b6b7ebd57e5cfac167f054cea90c18004b"}
Jul 31 00:06:23.393407 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.393344    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vfxzv" podStartSLOduration=3.652729832 podStartE2EDuration="23.393321881s" totalImagesPullingTime="19.740592049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:23.393266173 +0000 UTC m=+23.670509161" watchObservedRunningTime="2026-07-31 00:06:23.393321881 +0000 UTC m=+23.670564871"
Jul 31 00:06:23.771227 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:23.771188    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 00:06:24.210897 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:24.210777    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T00:06:23.771222863Z","UUID":"94d793cf-16a4-4398-8bce-d8a412cb234d","Handler":null,"Name":"","Endpoint":""}
Jul 31 00:06:24.213856 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:24.213835    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 00:06:24.214004 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:24.213871    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 00:06:24.242320 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:24.242287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:24.242509 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:24.242442    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:24.385448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:24.385415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm" event={"ID":"e516194c-eccc-4ff0-8d23-9f147554bbaf","Type":"ContainerStarted","Data":"64325599b9b6af582a4cf852a0b495d1d6c6ade537484c64c6b953305878f1cf"}
Jul 31 00:06:25.241809 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:25.241766    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:25.242003 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:25.241775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:25.242003 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:25.241899    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:25.242003 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:25.241975    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:25.389793 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:25.389756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm" event={"ID":"e516194c-eccc-4ff0-8d23-9f147554bbaf","Type":"ContainerStarted","Data":"88d712c93df507d118c0bc2e7a23595fed7194f3a54ee4bd7597da3dca803ea5"}
Jul 31 00:06:25.392986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:25.392961    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:06:25.393376 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:25.393340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"74f27c31ef704373b37a46e5f49ff886d852ac26e399574fd2c1fa8b7fc35dce"}
Jul 31 00:06:25.407059 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:25.407016    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.ec2.internal" podStartSLOduration=24.407002302 podStartE2EDuration="24.407002302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:23.406220302 +0000 UTC m=+23.683463291" watchObservedRunningTime="2026-07-31 00:06:25.407002302 +0000 UTC m=+25.684245291"
Jul 31 00:06:25.407180 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:25.407163    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfrzm" podStartSLOduration=2.603625434 podStartE2EDuration="25.407158946s" totalImagesPullingTime="22.803533512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:25.406659574 +0000 UTC m=+25.683902564" watchObservedRunningTime="2026-07-31 00:06:25.407158946 +0000 UTC m=+25.684401935"
Jul 31 00:06:26.242899 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:26.242862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:26.243092 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:26.243051    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:26.345546 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:26.345508    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:26.346079 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:26.346060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:27.242368 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:27.242164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:27.242820 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:27.242226    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:27.242820 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:27.242466    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:27.242820 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:27.242560    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:28.242396 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.242366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:28.242906 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:28.242486    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:28.404499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.404463    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:06:28.404978 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.404906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"c7fe63edcf98076f37c4cf886758983510a3b78bd4d6e91f351409b9fa5a440e"}
Jul 31 00:06:28.405494 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.405465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:28.405599 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.405508    2582 scope.go:117] "RemoveContainer" containerID="38dfb92665531cb50e89b438dced08c5f45bd90b35a4be2450a967c349865582"
Jul 31 00:06:28.405599 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.405527    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:28.405948 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.405921    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:28.421057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.420985    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:28.421227 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:28.421215    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:06:29.242727 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:29.242505    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:29.243358 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:29.242505    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:29.243358 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:29.242799    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:29.243358 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:29.242864    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:29.410478 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:29.410453    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:06:29.410928 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:29.410906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" event={"ID":"34a4c6a5-75f1-4516-bc55-374e81a2d2aa","Type":"ContainerStarted","Data":"9ccf64b23926eb11e28f17449c3884dbd7915ca91b7cdc9d78a0404982344f41"}
Jul 31 00:06:29.412787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:29.412706    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0dc9845-9e58-4a6e-816a-60c3ddb915fc" containerID="2745e247f10ff877d96142ca11b5847ae82b3ffb7a0336548a4206ab0e7eb9e6" exitCode=0
Jul 31 00:06:29.412787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:29.412765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerDied","Data":"2745e247f10ff877d96142ca11b5847ae82b3ffb7a0336548a4206ab0e7eb9e6"}
Jul 31 00:06:29.436468 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:29.436416    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42" podStartSLOduration=9.333118443 podStartE2EDuration="29.436401592s" totalImagesPullingTime="20.103283149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:29.436191445 +0000 UTC m=+29.713434433" watchObservedRunningTime="2026-07-31 00:06:29.436401592 +0000 UTC m=+29.713644582"
Jul 31 00:06:30.243235 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.243201    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:30.243741 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:30.243333    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:30.247549 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.247522    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2cg9j"]
Jul 31 00:06:30.247732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.247579    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z98bc"]
Jul 31 00:06:30.247732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.247693    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:30.247881 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:30.247857    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:30.258317 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.258278    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nn9bt"]
Jul 31 00:06:30.258491 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.258409    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:30.258555 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:30.258536    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:30.414971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.414938    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:30.415155 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:30.415066    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:30.991841 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.991804    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:30.991998 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.991954    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 31 00:06:30.992511 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:30.992488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dl8tl"
Jul 31 00:06:31.420900 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:31.420871    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0dc9845-9e58-4a6e-816a-60c3ddb915fc" containerID="3e10513efe22f3055e7e44b7a792f6921552e7f0543f9a5bcfcc797379007d6c" exitCode=0
Jul 31 00:06:31.421244 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:31.420930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerDied","Data":"3e10513efe22f3055e7e44b7a792f6921552e7f0543f9a5bcfcc797379007d6c"}
Jul 31 00:06:32.242028 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:32.241981    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:32.242028 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:32.242025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:32.242279 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:32.241984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:32.242279 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:32.242112    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:32.242279 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:32.242215    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:32.242444 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:32.242306    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:32.996710 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:32.996452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:32.996710 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:32.996692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:32.997119 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:32.996605    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:32.997119 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:32.996778    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:04.996762152 +0000 UTC m=+65.274005118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 00:06:32.997119 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:32.996790    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:32.997119 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:32.996835    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret podName:230af5e7-ff0d-4419-81ef-091cd8219ad9 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:04.996821301 +0000 UTC m=+65.274064269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret") pod "global-pull-secret-syncer-2cg9j" (UID: "230af5e7-ff0d-4419-81ef-091cd8219ad9") : object "kube-system"/"original-pull-secret" not registered
Jul 31 00:06:33.097862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:33.097826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:33.098047 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:33.097997    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 00:06:33.098047 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:33.098018    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 00:06:33.098047 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:33.098028    2582 projected.go:196] Error preparing data for projected volume kube-api-access-hwppv for pod openshift-network-diagnostics/network-check-target-nn9bt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:33.098145 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:33.098078    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv podName:7225ffa0-ba97-41e9-81fc-58db5c697506 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:05.098064048 +0000 UTC m=+65.375307019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwppv" (UniqueName: "kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv") pod "network-check-target-nn9bt" (UID: "7225ffa0-ba97-41e9-81fc-58db5c697506") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 00:06:33.427948 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:33.427910    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0dc9845-9e58-4a6e-816a-60c3ddb915fc" containerID="7dc73eb9b24c4a4edca4e7cad0e6a0627eec3508d4d25ec39cc38fa247ef4be3" exitCode=0
Jul 31 00:06:33.428132 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:33.427998    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerDied","Data":"7dc73eb9b24c4a4edca4e7cad0e6a0627eec3508d4d25ec39cc38fa247ef4be3"}
Jul 31 00:06:34.241995 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:34.241963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:34.242451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:34.241963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:34.242451 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:34.242100    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:06:34.242451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:34.242108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:34.242451 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:34.242193    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nn9bt" podUID="7225ffa0-ba97-41e9-81fc-58db5c697506"
Jul 31 00:06:34.242451 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:34.242280    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2cg9j" podUID="230af5e7-ff0d-4419-81ef-091cd8219ad9"
Jul 31 00:06:35.493952 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.493880    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-7.ec2.internal" event="NodeReady"
Jul 31 00:06:35.494294 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.494006    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 00:06:35.525292 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.525250    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29757600-j2grc"]
Jul 31 00:06:35.528977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.528941    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68bf5f746d-f5jzd"]
Jul 31 00:06:35.529188 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.529096    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.531741 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.531719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Jul 31 00:06:35.531865 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.531747    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-59jvp\""
Jul 31 00:06:35.532567 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.532545    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"]
Jul 31 00:06:35.532707 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.532691    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.534947 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.534925    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 00:06:35.535229 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.535208    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 00:06:35.535324 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.535226    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wdb2m\""
Jul 31 00:06:35.535324 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.535263    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 00:06:35.537138 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.536340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:35.537843 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.537824    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g5cl7"]
Jul 31 00:06:35.539084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.538888    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 31 00:06:35.539084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.538916    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p2wzq\""
Jul 31 00:06:35.540225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.539841    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 31 00:06:35.540999 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.540977    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 00:06:35.541892 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.541874    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29757600-j2grc"]
Jul 31 00:06:35.541985 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.541977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.543706 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.543686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68bf5f746d-f5jzd"]
Jul 31 00:06:35.544416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.544402    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 00:06:35.544510 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.544457    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nnjn4\""
Jul 31 00:06:35.544510 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.544464    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 00:06:35.546542 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.546521    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ptks5"]
Jul 31 00:06:35.550155 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.550135    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g5cl7"]
Jul 31 00:06:35.550251 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.550243    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:35.552946 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.552858    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 00:06:35.552946 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.552933    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 00:06:35.553124 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.553100    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 00:06:35.553216 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.553100    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5mc7x\""
Jul 31 00:06:35.556519 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.556498    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"]
Jul 31 00:06:35.560433 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.560346    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptks5"]
Jul 31 00:06:35.614167 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-installation-pull-secrets\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.614167 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7m44\" (UniqueName: \"kubernetes.io/projected/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-kube-api-access-r7m44\") pod \"image-pruner-29757600-j2grc\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") " pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.614421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-certificates\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.614421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-bound-sa-token\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.614421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-trusted-ca\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.614421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw998\" (UniqueName: \"kubernetes.io/projected/5af8df01-0684-4193-8bae-d83e5be683b8-kube-api-access-nw998\") pod \"ingress-canary-ptks5\" (UID: \"5af8df01-0684-4193-8bae-d83e5be683b8\") " pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:35.614421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-serviceca\") pod \"image-pruner-29757600-j2grc\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") " pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.614421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af8df01-0684-4193-8bae-d83e5be683b8-cert\") pod \"ingress-canary-ptks5\" (UID: \"5af8df01-0684-4193-8bae-d83e5be683b8\") " pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5a84a2d-03b1-4dca-9812-1fab6279e254-tmp-dir\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p8pz\" (UniqueName: \"kubernetes.io/projected/d5a84a2d-03b1-4dca-9812-1fab6279e254-kube-api-access-6p8pz\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-image-registry-private-configuration\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b693ba4-32ca-4c1b-b98a-f8699e64b277-ca-trust-extracted\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.614738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9cm\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-kube-api-access-bj9cm\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.615051 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be762795-9b56-40c0-ba08-0c27c20e465d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:35.615051 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.614765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5a84a2d-03b1-4dca-9812-1fab6279e254-config-volume\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.715221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-certificates\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-bound-sa-token\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-trusted-ca\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw998\" (UniqueName: \"kubernetes.io/projected/5af8df01-0684-4193-8bae-d83e5be683b8-kube-api-access-nw998\") pod \"ingress-canary-ptks5\" (UID: \"5af8df01-0684-4193-8bae-d83e5be683b8\") " pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-serviceca\") pod \"image-pruner-29757600-j2grc\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") " pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af8df01-0684-4193-8bae-d83e5be683b8-cert\") pod \"ingress-canary-ptks5\" (UID: \"5af8df01-0684-4193-8bae-d83e5be683b8\") " pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.715428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5a84a2d-03b1-4dca-9812-1fab6279e254-tmp-dir\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p8pz\" (UniqueName: \"kubernetes.io/projected/d5a84a2d-03b1-4dca-9812-1fab6279e254-kube-api-access-6p8pz\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-image-registry-private-configuration\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:35.715490    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b693ba4-32ca-4c1b-b98a-f8699e64b277-ca-trust-extracted\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:35.715576    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:06:36.215554392 +0000 UTC m=+36.492797365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9cm\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-kube-api-access-bj9cm\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be762795-9b56-40c0-ba08-0c27c20e465d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5a84a2d-03b1-4dca-9812-1fab6279e254-config-volume\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-installation-pull-secrets\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7m44\" (UniqueName: \"kubernetes.io/projected/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-kube-api-access-r7m44\") pod \"image-pruner-29757600-j2grc\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") " pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:35.715798    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:06:35.715826 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:35.715816    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5a84a2d-03b1-4dca-9812-1fab6279e254-tmp-dir\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:35.715905    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:36.2158854 +0000 UTC m=+36.493128382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-certificates\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:35.715942    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.715978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-serviceca\") pod \"image-pruner-29757600-j2grc\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") " pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:35.715995    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:36.215980938 +0000 UTC m=+36.493223906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.716343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b693ba4-32ca-4c1b-b98a-f8699e64b277-ca-trust-extracted\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.716448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.716426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/be762795-9b56-40c0-ba08-0c27c20e465d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:35.716881 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.716526    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5a84a2d-03b1-4dca-9812-1fab6279e254-config-volume\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.717000 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.716978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-trusted-ca\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.720222 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.720202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-image-registry-private-configuration\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.720222 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.720209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5af8df01-0684-4193-8bae-d83e5be683b8-cert\") pod \"ingress-canary-ptks5\" (UID: \"5af8df01-0684-4193-8bae-d83e5be683b8\") " pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:35.720380 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.720202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-installation-pull-secrets\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.723995 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.723963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw998\" (UniqueName: \"kubernetes.io/projected/5af8df01-0684-4193-8bae-d83e5be683b8-kube-api-access-nw998\") pod \"ingress-canary-ptks5\" (UID: \"5af8df01-0684-4193-8bae-d83e5be683b8\") " pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:35.725451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.725425    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-bound-sa-token\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.725550 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.725445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7m44\" (UniqueName: \"kubernetes.io/projected/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-kube-api-access-r7m44\") pod \"image-pruner-29757600-j2grc\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") " pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.726401 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.726379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p8pz\" (UniqueName: \"kubernetes.io/projected/d5a84a2d-03b1-4dca-9812-1fab6279e254-kube-api-access-6p8pz\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:35.726486 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.726399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9cm\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-kube-api-access-bj9cm\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:35.842752 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.842715    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:06:35.873961 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:35.873929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptks5"
Jul 31 00:06:36.005471 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.005396    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29757600-j2grc"]
Jul 31 00:06:36.008985 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:36.008951    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4214a0f7_ace1_4a6b_b45a_42e9edbb4bea.slice/crio-dfa47f46218e412f7b8b29046c40acd6ef77fba2895080c2838798b5b7223511 WatchSource:0}: Error finding container dfa47f46218e412f7b8b29046c40acd6ef77fba2895080c2838798b5b7223511: Status 404 returned error can't find the container with id dfa47f46218e412f7b8b29046c40acd6ef77fba2895080c2838798b5b7223511
Jul 31 00:06:36.041042 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.040796    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptks5"]
Jul 31 00:06:36.044687 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:06:36.044663    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af8df01_0684_4193_8bae_d83e5be683b8.slice/crio-75e5a0ab0f16616b470eebfd73a0e226878c206260bf9f2baa262117e89c0e6d WatchSource:0}: Error finding container 75e5a0ab0f16616b470eebfd73a0e226878c206260bf9f2baa262117e89c0e6d: Status 404 returned error can't find the container with id 75e5a0ab0f16616b470eebfd73a0e226878c206260bf9f2baa262117e89c0e6d
Jul 31 00:06:36.172136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.172096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:36.220163 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.220129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:36.220350 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.220173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:36.220350 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.220209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:36.220350 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:36.220277    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:06:36.220350 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:36.220343    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:06:37.220326162 +0000 UTC m=+37.497569134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:06:36.220350 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:36.220342    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:06:36.220553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:36.220357    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:06:36.220553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:36.220369    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:06:36.220553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:36.220375    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:37.220368665 +0000 UTC m=+37.497611632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:06:36.220553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:36.220414    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:37.220399882 +0000 UTC m=+37.497642863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:06:36.242070 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.242035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:06:36.242221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.242045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:06:36.242221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.242164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:06:36.244976 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.244956    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 00:06:36.245121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.245046    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbfb2\""
Jul 31 00:06:36.245121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.245046    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 00:06:36.245121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.245082    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 00:06:36.245121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.245114    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 00:06:36.245342 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.245328    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmpl\""
Jul 31 00:06:36.258642 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.258596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:36.353959 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.353874    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:36.436113 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.436075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptks5" event={"ID":"5af8df01-0684-4193-8bae-d83e5be683b8","Type":"ContainerStarted","Data":"75e5a0ab0f16616b470eebfd73a0e226878c206260bf9f2baa262117e89c0e6d"}
Jul 31 00:06:36.437450 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.437424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29757600-j2grc" event={"ID":"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea","Type":"ContainerStarted","Data":"a0ab23529ad9251c4fc115236ccdcf3e9548f8bfacc1f38254c84794209c9d90"}
Jul 31 00:06:36.437555 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.437466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29757600-j2grc" event={"ID":"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea","Type":"ContainerStarted","Data":"dfa47f46218e412f7b8b29046c40acd6ef77fba2895080c2838798b5b7223511"}
Jul 31 00:06:36.453720 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:36.453644    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29757600-j2grc" podStartSLOduration=382.453605072 podStartE2EDuration="6m22.453605072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:00:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:36.452735894 +0000 UTC m=+36.729978876" watchObservedRunningTime="2026-07-31 00:06:36.453605072 +0000 UTC m=+36.730848062"
Jul 31 00:06:37.229283 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:37.229248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:37.229283 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:37.229294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:37.229327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:37.229430    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:37.229472    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:37.229518    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:06:39.229493781 +0000 UTC m=+39.506736749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:37.229560    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:39.229544764 +0000 UTC m=+39.506787734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:37.229490    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:37.229579    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:06:37.230161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:37.229605    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:39.229597029 +0000 UTC m=+39.506839999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:06:39.002211 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:39.002173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:39.248041 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:39.248003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:39.248235 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:39.248056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:39.248235 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:39.248092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:39.248235 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:39.248203    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:06:39.248235 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:39.248224    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:06:39.248408 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:39.248239    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:06:39.248408 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:39.248238    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:06:39.248408 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:39.248292    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:06:43.248275552 +0000 UTC m=+43.525518519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:06:39.248408 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:39.248308    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:43.248302162 +0000 UTC m=+43.525545129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:06:39.248408 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:39.248323    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:43.248313051 +0000 UTC m=+43.525556018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:06:40.451325 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:40.451280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptks5" event={"ID":"5af8df01-0684-4193-8bae-d83e5be683b8","Type":"ContainerStarted","Data":"38b8f16fd5e041f8427e733a49fef7074b63f3510f945c3ef771c0fdff11f745"}
Jul 31 00:06:40.467591 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:40.467540    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ptks5" podStartSLOduration=1.255391148 podStartE2EDuration="5.46752453s" totalImagesPullingTime="4.212133382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:40.465556095 +0000 UTC m=+40.742799084" watchObservedRunningTime="2026-07-31 00:06:40.46752453 +0000 UTC m=+40.744767519"
Jul 31 00:06:41.456443 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:41.456405    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0dc9845-9e58-4a6e-816a-60c3ddb915fc" containerID="ca2c00e8c1ac9d745e64b315c36399fd52b576712125201378ce2a53e8e4d221" exitCode=0
Jul 31 00:06:41.456842 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:41.456484    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerDied","Data":"ca2c00e8c1ac9d745e64b315c36399fd52b576712125201378ce2a53e8e4d221"}
Jul 31 00:06:42.461445 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:42.461407    2582 generic.go:356] "Generic (PLEG): container finished" podID="a0dc9845-9e58-4a6e-816a-60c3ddb915fc" containerID="94d5e7e2debdcdb26eb2a6d194d56e8afae1bf97c0af1af8c44c5ed62ee3fa8a" exitCode=0
Jul 31 00:06:42.461445 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:42.461451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerDied","Data":"94d5e7e2debdcdb26eb2a6d194d56e8afae1bf97c0af1af8c44c5ed62ee3fa8a"}
Jul 31 00:06:43.278247 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:43.278198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:43.278247 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:43.278253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:43.278469 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:43.278288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:43.278469 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:43.278367    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:06:43.278469 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:43.278410    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:06:43.278469 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:43.278435    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:06:51.278415604 +0000 UTC m=+51.555658588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:06:43.278469 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:43.278462    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:51.278449243 +0000 UTC m=+51.555692211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:06:43.278469 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:43.278413    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:06:43.278688 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:43.278476    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:06:43.278688 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:43.278503    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:06:51.27849681 +0000 UTC m=+51.555739777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:06:43.467173 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:43.467132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" event={"ID":"a0dc9845-9e58-4a6e-816a-60c3ddb915fc","Type":"ContainerStarted","Data":"415bcc9e4876420e75da9fe62b1032b5a34bf70f1686fe1da49916181c808bf0"}
Jul 31 00:06:43.493411 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:43.493360    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tgp6x" podStartSLOduration=7.821037603 podStartE2EDuration="43.493339057s" totalImagesPullingTime="35.672301454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:06:43.491346528 +0000 UTC m=+43.768589519" watchObservedRunningTime="2026-07-31 00:06:43.493339057 +0000 UTC m=+43.770582072"
Jul 31 00:06:43.831541 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:43.831501    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:43.932866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:43.932832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:44.105421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:44.105332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:44.151687 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:44.151645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:51.341956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:51.341916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:51.342008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:51.342036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:51.342102    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:51.342135    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:51.342116    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:51.342117    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:51.342202    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:07.342179797 +0000 UTC m=+67.619422777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:51.342295    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:07.342279214 +0000 UTC m=+67.619522184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:06:51.342553 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:06:51.342311    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:07:07.342301008 +0000 UTC m=+67.619543984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:06:53.289499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:53.289466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:06:53.384555 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:06:53.384518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log" limit=1024
Jul 31 00:07:00.432354 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:00.432311    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8v42"
Jul 31 00:07:05.052136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.052091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:07:05.052662 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.052156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:07:05.054638 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.054605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 00:07:05.054750 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.054662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 00:07:05.062472 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:05.062445    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 00:07:05.062584 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:05.062515    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:08:09.062495315 +0000 UTC m=+129.339738283 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : secret "metrics-daemon-secret" not found
Jul 31 00:07:05.065849 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.065823    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/230af5e7-ff0d-4419-81ef-091cd8219ad9-original-pull-secret\") pod \"global-pull-secret-syncer-2cg9j\" (UID: \"230af5e7-ff0d-4419-81ef-091cd8219ad9\") " pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:07:05.152963 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.152922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:07:05.155741 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.155723    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 00:07:05.166338 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.166309    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 00:07:05.176902 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.176875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwppv\" (UniqueName: \"kubernetes.io/projected/7225ffa0-ba97-41e9-81fc-58db5c697506-kube-api-access-hwppv\") pod \"network-check-target-nn9bt\" (UID: \"7225ffa0-ba97-41e9-81fc-58db5c697506\") " pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:07:05.353521 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.353431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2cg9j"
Jul 31 00:07:05.366976 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.366947    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmpl\""
Jul 31 00:07:05.374238 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.374214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:07:05.480460 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.480429    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2cg9j"]
Jul 31 00:07:05.484021 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:07:05.483994    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230af5e7_ff0d_4419_81ef_091cd8219ad9.slice/crio-ab253cb8267bde0fa7ba8270b40c35b8804c70a1a38b0c0006b73b64ff5bdaf7 WatchSource:0}: Error finding container ab253cb8267bde0fa7ba8270b40c35b8804c70a1a38b0c0006b73b64ff5bdaf7: Status 404 returned error can't find the container with id ab253cb8267bde0fa7ba8270b40c35b8804c70a1a38b0c0006b73b64ff5bdaf7
Jul 31 00:07:05.498709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.498683    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nn9bt"]
Jul 31 00:07:05.501711 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:07:05.501689    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7225ffa0_ba97_41e9_81fc_58db5c697506.slice/crio-fe48b74110f12297d056fb051db6ae02f09b1518cc0fa9838fc3fe73d7b8ba4f WatchSource:0}: Error finding container fe48b74110f12297d056fb051db6ae02f09b1518cc0fa9838fc3fe73d7b8ba4f: Status 404 returned error can't find the container with id fe48b74110f12297d056fb051db6ae02f09b1518cc0fa9838fc3fe73d7b8ba4f
Jul 31 00:07:05.523197 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.523158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nn9bt" event={"ID":"7225ffa0-ba97-41e9-81fc-58db5c697506","Type":"ContainerStarted","Data":"fe48b74110f12297d056fb051db6ae02f09b1518cc0fa9838fc3fe73d7b8ba4f"}
Jul 31 00:07:05.524230 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:05.524208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2cg9j" event={"ID":"230af5e7-ff0d-4419-81ef-091cd8219ad9","Type":"ContainerStarted","Data":"ab253cb8267bde0fa7ba8270b40c35b8804c70a1a38b0c0006b73b64ff5bdaf7"}
Jul 31 00:07:07.371203 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:07.371158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:07.371222    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:07.371260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:07.371352    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:07.371368    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:07.371382    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:07.371408    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:07.371445    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:39.371419426 +0000 UTC m=+99.648662397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:07.371472    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:07:39.371461994 +0000 UTC m=+99.648704978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:07:07.371700 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:07.371488    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:07:39.371480148 +0000 UTC m=+99.648723121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:10.538738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:10.538697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nn9bt" event={"ID":"7225ffa0-ba97-41e9-81fc-58db5c697506","Type":"ContainerStarted","Data":"f3a8c7fc8c6494c3572f0d1bfa5b4da876bbf166a6c91b25c1c5617c0024f656"}
Jul 31 00:07:10.539213 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:10.538891    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:07:10.540166 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:10.540137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2cg9j" event={"ID":"230af5e7-ff0d-4419-81ef-091cd8219ad9","Type":"ContainerStarted","Data":"99e02d397752fbca80aaf5d0bd5a217dabfc53f09bce9253cdb886f31ebec48a"}
Jul 31 00:07:10.555562 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:10.555519    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nn9bt" podStartSLOduration=65.856201375 podStartE2EDuration="1m10.555505246s" totalImagesPullingTime="4.699303871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:10.554153646 +0000 UTC m=+70.831396644" watchObservedRunningTime="2026-07-31 00:07:10.555505246 +0000 UTC m=+70.832748235"
Jul 31 00:07:10.567421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:10.567314    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2cg9j" podStartSLOduration=65.847303792 podStartE2EDuration="1m10.567293701s" totalImagesPullingTime="4.719989909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:07:10.566975818 +0000 UTC m=+70.844218807" watchObservedRunningTime="2026-07-31 00:07:10.567293701 +0000 UTC m=+70.844536684"
Jul 31 00:07:39.394334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:39.394170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:07:39.394334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:39.394238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:07:39.394334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:39.394272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:07:39.394962 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:39.394331    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:07:39.394962 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:39.394393    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:07:39.394962 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:39.394407    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:07:39.394962 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:39.394414    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:08:43.394393323 +0000 UTC m=+163.671636290 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:07:39.394962 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:39.394421    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:07:39.394962 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:39.394439    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:08:43.394427449 +0000 UTC m=+163.671670416 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:07:39.394962 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:07:39.394462    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:08:43.394449397 +0000 UTC m=+163.671692368 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:07:41.545058 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:07:41.545002    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nn9bt"
Jul 31 00:08:09.117279 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:09.117227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:08:09.117792 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:09.117384    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 00:08:09.117792 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:09.117464    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:11.117446273 +0000 UTC m=+251.394689240 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : secret "metrics-daemon-secret" not found
Jul 31 00:08:38.552199 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:38.552134    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277"
Jul 31 00:08:38.560324 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:38.560285    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb" podUID="be762795-9b56-40c0-ba08-0c27c20e465d"
Jul 31 00:08:38.568462 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:38.568426    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g5cl7" podUID="d5a84a2d-03b1-4dca-9812-1fab6279e254"
Jul 31 00:08:38.748546 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:38.748514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:08:38.748546 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:38.748545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:08:38.748773 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:38.748668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:08:39.259232 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:39.259190    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:08:43.464512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:43.464465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:08:43.464512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:43.464516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:43.464607    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:43.464610    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:43.464653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:43.464697    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls podName:d5a84a2d-03b1-4dca-9812-1fab6279e254 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:45.46468059 +0000 UTC m=+285.741923557 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls") pod "dns-default-g5cl7" (UID: "d5a84a2d-03b1-4dca-9812-1fab6279e254") : secret "dns-default-metrics-tls" not found
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:43.464705    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:43.464713    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert podName:be762795-9b56-40c0-ba08-0c27c20e465d nodeName:}" failed. No retries permitted until 2026-07-31 00:10:45.464706418 +0000 UTC m=+285.741949384 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8c2qb" (UID: "be762795-9b56-40c0-ba08-0c27c20e465d") : secret "networking-console-plugin-cert" not found
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:43.464718    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bf5f746d-f5jzd: secret "image-registry-tls" not found
Jul 31 00:08:43.464974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:08:43.464763    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls podName:8b693ba4-32ca-4c1b-b98a-f8699e64b277 nodeName:}" failed. No retries permitted until 2026-07-31 00:10:45.464750375 +0000 UTC m=+285.741993347 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls") pod "image-registry-68bf5f746d-f5jzd" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277") : secret "image-registry-tls" not found
Jul 31 00:08:50.243419 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:08:50.243381    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:10:11.207066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:11.207006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:10:11.207570 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:11.207170    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 00:10:11.207570 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:11.207244    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs podName:29ae0441-1a78-4692-97ad-a2749a174cd3 nodeName:}" failed. No retries permitted until 2026-07-31 00:12:13.207226349 +0000 UTC m=+373.484469316 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs") pod "network-metrics-daemon-z98bc" (UID: "29ae0441-1a78-4692-97ad-a2749a174cd3") : secret "metrics-daemon-secret" not found
Jul 31 00:10:14.580734 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.580695    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"]
Jul 31 00:10:14.583509 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.583486    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-6jz89"]
Jul 31 00:10:14.583641 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.583602    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"
Jul 31 00:10:14.586126 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.586107    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-kjp2v"]
Jul 31 00:10:14.586246 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.586200    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.586396 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.586376    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-94lct\""
Jul 31 00:10:14.586783 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.586761    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.586880 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.586760    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.588833 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.588813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.588938 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.588836    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.588938 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.588920    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rg4n5\""
Jul 31 00:10:14.589335 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.589317    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 31 00:10:14.589429 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.589343    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.589429 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.589382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 31 00:10:14.592710 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.592668    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s9fqt\""
Jul 31 00:10:14.592710 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.592703    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 31 00:10:14.592855 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.592706    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.593067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.593051    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 31 00:10:14.593067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.593062    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.597943 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.597920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"]
Jul 31 00:10:14.598304 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.598285    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 31 00:10:14.601422 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.601400    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-6jz89"]
Jul 31 00:10:14.604961 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.603944    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 31 00:10:14.613092 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.613071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-kjp2v"]
Jul 31 00:10:14.679248 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.679211    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-689c4fc56b-qgjfq"]
Jul 31 00:10:14.682207 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.682179    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.685320 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.685296    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 31 00:10:14.685561 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.685546    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 31 00:10:14.685828 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.685808    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 31 00:10:14.686076 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.686053    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-55kkj\""
Jul 31 00:10:14.686076 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.686072    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 00:10:14.686206 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.686094    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 31 00:10:14.686789 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.686772    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 00:10:14.696815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.696789    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-689c4fc56b-qgjfq"]
Jul 31 00:10:14.736715 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5edd60ed-3278-45f3-8eb8-9dcca014cf43-trusted-ca-bundle\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.736715 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998b5748-05d2-49de-8e7f-ec06934bbffd-serving-cert\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.736923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5edd60ed-3278-45f3-8eb8-9dcca014cf43-tmp\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.736923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998b5748-05d2-49de-8e7f-ec06934bbffd-config\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.736923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5edd60ed-3278-45f3-8eb8-9dcca014cf43-service-ca-bundle\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.736923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55vm5\" (UniqueName: \"kubernetes.io/projected/ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d-kube-api-access-55vm5\") pod \"volume-data-source-validator-5b8776669-rtzcf\" (UID: \"ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"
Jul 31 00:10:14.736923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5edd60ed-3278-45f3-8eb8-9dcca014cf43-snapshots\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.737102 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736936    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/998b5748-05d2-49de-8e7f-ec06934bbffd-trusted-ca\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.737102 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.736988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfstr\" (UniqueName: \"kubernetes.io/projected/5edd60ed-3278-45f3-8eb8-9dcca014cf43-kube-api-access-mfstr\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.737102 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.737050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5edd60ed-3278-45f3-8eb8-9dcca014cf43-serving-cert\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.737102 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.737084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6gnl\" (UniqueName: \"kubernetes.io/projected/998b5748-05d2-49de-8e7f-ec06934bbffd-kube-api-access-p6gnl\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.837972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.837875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5edd60ed-3278-45f3-8eb8-9dcca014cf43-service-ca-bundle\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.837972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.837929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vm5\" (UniqueName: \"kubernetes.io/projected/ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d-kube-api-access-55vm5\") pod \"volume-data-source-validator-5b8776669-rtzcf\" (UID: \"ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"
Jul 31 00:10:14.838189 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.837986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5edd60ed-3278-45f3-8eb8-9dcca014cf43-snapshots\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.838189 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/998b5748-05d2-49de-8e7f-ec06934bbffd-trusted-ca\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.838189 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l78gx\" (UniqueName: \"kubernetes.io/projected/80cf608c-b8d4-41a4-96df-41d4f0e9654a-kube-api-access-l78gx\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.838189 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-default-certificate\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.838410 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfstr\" (UniqueName: \"kubernetes.io/projected/5edd60ed-3278-45f3-8eb8-9dcca014cf43-kube-api-access-mfstr\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.838410 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-stats-auth\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.838410 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5edd60ed-3278-45f3-8eb8-9dcca014cf43-serving-cert\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.838410 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6gnl\" (UniqueName: \"kubernetes.io/projected/998b5748-05d2-49de-8e7f-ec06934bbffd-kube-api-access-p6gnl\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.838410 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.838716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.838716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5edd60ed-3278-45f3-8eb8-9dcca014cf43-trusted-ca-bundle\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.838716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998b5748-05d2-49de-8e7f-ec06934bbffd-serving-cert\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.838716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5edd60ed-3278-45f3-8eb8-9dcca014cf43-tmp\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.838716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998b5748-05d2-49de-8e7f-ec06934bbffd-config\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.838957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838762    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5edd60ed-3278-45f3-8eb8-9dcca014cf43-snapshots\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.838957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.838813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5edd60ed-3278-45f3-8eb8-9dcca014cf43-service-ca-bundle\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.839120 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.839008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5edd60ed-3278-45f3-8eb8-9dcca014cf43-tmp\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.839120 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.839045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/998b5748-05d2-49de-8e7f-ec06934bbffd-trusted-ca\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.839200 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.839183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998b5748-05d2-49de-8e7f-ec06934bbffd-config\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.839414 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.839395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5edd60ed-3278-45f3-8eb8-9dcca014cf43-trusted-ca-bundle\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.840846 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.840817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5edd60ed-3278-45f3-8eb8-9dcca014cf43-serving-cert\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.840946 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.840817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998b5748-05d2-49de-8e7f-ec06934bbffd-serving-cert\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.846980 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.846952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6gnl\" (UniqueName: \"kubernetes.io/projected/998b5748-05d2-49de-8e7f-ec06934bbffd-kube-api-access-p6gnl\") pod \"console-operator-5ccd6b445f-6jz89\" (UID: \"998b5748-05d2-49de-8e7f-ec06934bbffd\") " pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.847438 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.847415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfstr\" (UniqueName: \"kubernetes.io/projected/5edd60ed-3278-45f3-8eb8-9dcca014cf43-kube-api-access-mfstr\") pod \"insights-operator-77696685b-kjp2v\" (UID: \"5edd60ed-3278-45f3-8eb8-9dcca014cf43\") " pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.847597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.847577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vm5\" (UniqueName: \"kubernetes.io/projected/ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d-kube-api-access-55vm5\") pod \"volume-data-source-validator-5b8776669-rtzcf\" (UID: \"ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"
Jul 31 00:10:14.894355 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.894317    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"
Jul 31 00:10:14.904680 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.904632    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:14.912476 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.912441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-kjp2v"
Jul 31 00:10:14.939931 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.939888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78gx\" (UniqueName: \"kubernetes.io/projected/80cf608c-b8d4-41a4-96df-41d4f0e9654a-kube-api-access-l78gx\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.940117 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.939941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-default-certificate\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.940117 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.939975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-stats-auth\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.940117 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.940027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.940117 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.940055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.940315 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:14.940223    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 00:10:14.940315 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:14.940304    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:15.440266243 +0000 UTC m=+255.717509209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : secret "router-metrics-certs-default" not found
Jul 31 00:10:14.940422 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:14.940400    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:15.440387859 +0000 UTC m=+255.717630839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : configmap references non-existent config key: service-ca.crt
Jul 31 00:10:14.942649 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.942607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-default-certificate\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.943159 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.943138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-stats-auth\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:14.950529 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:14.950317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78gx\" (UniqueName: \"kubernetes.io/projected/80cf608c-b8d4-41a4-96df-41d4f0e9654a-kube-api-access-l78gx\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:15.034821 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.034782    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf"]
Jul 31 00:10:15.039097 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:15.039053    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9f3cb1_03a8_4bc2_a3a5_463d4f21875d.slice/crio-c0f94c99fdaef306439e18293fea36b8e0e31f5f69e501fecfcc4e9fb0da1cb8 WatchSource:0}: Error finding container c0f94c99fdaef306439e18293fea36b8e0e31f5f69e501fecfcc4e9fb0da1cb8: Status 404 returned error can't find the container with id c0f94c99fdaef306439e18293fea36b8e0e31f5f69e501fecfcc4e9fb0da1cb8
Jul 31 00:10:15.053020 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.052996    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-6jz89"]
Jul 31 00:10:15.056107 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:15.056081    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998b5748_05d2_49de_8e7f_ec06934bbffd.slice/crio-357b287a768f42a6ef98b4673e055b99499dca6343ac024109458bb84b125c69 WatchSource:0}: Error finding container 357b287a768f42a6ef98b4673e055b99499dca6343ac024109458bb84b125c69: Status 404 returned error can't find the container with id 357b287a768f42a6ef98b4673e055b99499dca6343ac024109458bb84b125c69
Jul 31 00:10:15.077183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.077158    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-kjp2v"]
Jul 31 00:10:15.079290 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:15.079269    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edd60ed_3278_45f3_8eb8_9dcca014cf43.slice/crio-b8563179f8e919360f3d4ae7f87cf2225ba1c991074cbfb2047c81f1a3b658d7 WatchSource:0}: Error finding container b8563179f8e919360f3d4ae7f87cf2225ba1c991074cbfb2047c81f1a3b658d7: Status 404 returned error can't find the container with id b8563179f8e919360f3d4ae7f87cf2225ba1c991074cbfb2047c81f1a3b658d7
Jul 31 00:10:15.443358 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.443326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:15.443566 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.443364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:15.443566 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:15.443485    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 00:10:15.443566 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:15.443502    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:16.443485985 +0000 UTC m=+256.720728954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : configmap references non-existent config key: service-ca.crt
Jul 31 00:10:15.443566 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:15.443547    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:16.443530833 +0000 UTC m=+256.720773827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : secret "router-metrics-certs-default" not found
Jul 31 00:10:15.980270 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.980228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf" event={"ID":"ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d","Type":"ContainerStarted","Data":"c0f94c99fdaef306439e18293fea36b8e0e31f5f69e501fecfcc4e9fb0da1cb8"}
Jul 31 00:10:15.981715 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.981657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" event={"ID":"998b5748-05d2-49de-8e7f-ec06934bbffd","Type":"ContainerStarted","Data":"357b287a768f42a6ef98b4673e055b99499dca6343ac024109458bb84b125c69"}
Jul 31 00:10:15.982935 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:15.982907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kjp2v" event={"ID":"5edd60ed-3278-45f3-8eb8-9dcca014cf43","Type":"ContainerStarted","Data":"b8563179f8e919360f3d4ae7f87cf2225ba1c991074cbfb2047c81f1a3b658d7"}
Jul 31 00:10:16.452497 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:16.452453    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:16.452497 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:16.452501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:16.452853 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:16.452619    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 00:10:16.452853 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:16.452710    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:18.452682164 +0000 UTC m=+258.729925176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : configmap references non-existent config key: service-ca.crt
Jul 31 00:10:16.452853 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:16.452742    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:18.452730579 +0000 UTC m=+258.729973550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : secret "router-metrics-certs-default" not found
Jul 31 00:10:16.988420 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:16.988379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf" event={"ID":"ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d","Type":"ContainerStarted","Data":"d3897186d31fdd254ca66673d81d7b3fd42d43ecc16fc9f1ee715ac9223d76ca"}
Jul 31 00:10:17.003537 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:17.003483    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rtzcf" podStartSLOduration=1.582252161 podStartE2EDuration="3.003465201s" totalImagesPullingTime="1.42121304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:17.002333922 +0000 UTC m=+257.279576910" watchObservedRunningTime="2026-07-31 00:10:17.003465201 +0000 UTC m=+257.280708189"
Jul 31 00:10:17.997010 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:17.996905    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/0.log"
Jul 31 00:10:17.997010 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:17.996952    2582 generic.go:356] "Generic (PLEG): container finished" podID="998b5748-05d2-49de-8e7f-ec06934bbffd" containerID="25705a0d24f3ab17fa6894a24fcd721debcd6ffbd99da55b499a194fc5ad4e48" exitCode=255
Jul 31 00:10:17.997513 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:17.997056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" event={"ID":"998b5748-05d2-49de-8e7f-ec06934bbffd","Type":"ContainerDied","Data":"25705a0d24f3ab17fa6894a24fcd721debcd6ffbd99da55b499a194fc5ad4e48"}
Jul 31 00:10:17.997513 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:17.997264    2582 scope.go:117] "RemoveContainer" containerID="25705a0d24f3ab17fa6894a24fcd721debcd6ffbd99da55b499a194fc5ad4e48"
Jul 31 00:10:17.998655 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:17.998610    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kjp2v" event={"ID":"5edd60ed-3278-45f3-8eb8-9dcca014cf43","Type":"ContainerStarted","Data":"b7324c0f3bd54bf2447b6fd0f59a0289d78f5854fa201cb945bae0f7d44acb68"}
Jul 31 00:10:18.468894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.468849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:18.468894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.468892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:18.469134 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:18.469027    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 00:10:18.469134 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:18.469062    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.469040563 +0000 UTC m=+262.746283535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : configmap references non-existent config key: service-ca.crt
Jul 31 00:10:18.469134 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:18.469094    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.469083648 +0000 UTC m=+262.746326621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : secret "router-metrics-certs-default" not found
Jul 31 00:10:18.649486 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.649423    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-kjp2v" podStartSLOduration=2.037854991 podStartE2EDuration="4.649403939s" totalImagesPullingTime="2.611548948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:18.02773106 +0000 UTC m=+258.304974048" watchObservedRunningTime="2026-07-31 00:10:18.649403939 +0000 UTC m=+258.926646928"
Jul 31 00:10:18.650312 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.650294    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tx87b"]
Jul 31 00:10:18.653476 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.653456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.655949 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.655932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 00:10:18.655949 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.655942    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 00:10:18.656082 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.656049    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f672z\""
Jul 31 00:10:18.662355 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.662324    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tx87b"]
Jul 31 00:10:18.770881 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.770847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.770881 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.770888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-crio-socket\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.771104 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.770988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgws8\" (UniqueName: \"kubernetes.io/projected/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-api-access-dgws8\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.771104 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.771078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-data-volume\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.771171 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.771104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.871886 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.871847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.871886 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.871890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-crio-socket\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.872098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.871945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgws8\" (UniqueName: \"kubernetes.io/projected/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-api-access-dgws8\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.872098 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:18.871986    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 00:10:18.872098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.872005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-data-volume\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.872098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.872031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.872098 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:18.872063    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:19.372042277 +0000 UTC m=+259.649285264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : configmap "kube-rbac-proxy" not found
Jul 31 00:10:18.872098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.872067    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-crio-socket\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.872288 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:18.872123    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:18.872288 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:18.872172    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:19.37215803 +0000 UTC m=+259.649400998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:18.872364 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.872301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-data-volume\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:18.880413 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:18.880389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgws8\" (UniqueName: \"kubernetes.io/projected/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-api-access-dgws8\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:19.003101 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.003071    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:10:19.003486 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.003468    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/0.log"
Jul 31 00:10:19.003523 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.003500    2582 generic.go:356] "Generic (PLEG): container finished" podID="998b5748-05d2-49de-8e7f-ec06934bbffd" containerID="ae7a8b937be7289c694d6a7a901f628504141d0b6caa2c17afb61a6e44e52773" exitCode=255
Jul 31 00:10:19.003560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.003531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" event={"ID":"998b5748-05d2-49de-8e7f-ec06934bbffd","Type":"ContainerDied","Data":"ae7a8b937be7289c694d6a7a901f628504141d0b6caa2c17afb61a6e44e52773"}
Jul 31 00:10:19.003598 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.003586    2582 scope.go:117] "RemoveContainer" containerID="25705a0d24f3ab17fa6894a24fcd721debcd6ffbd99da55b499a194fc5ad4e48"
Jul 31 00:10:19.003840 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.003820    2582 scope.go:117] "RemoveContainer" containerID="ae7a8b937be7289c694d6a7a901f628504141d0b6caa2c17afb61a6e44e52773"
Jul 31 00:10:19.004044 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:19.004019    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-6jz89_openshift-console-operator(998b5748-05d2-49de-8e7f-ec06934bbffd)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" podUID="998b5748-05d2-49de-8e7f-ec06934bbffd"
Jul 31 00:10:19.376408 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.376370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:19.376408 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:19.376413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:19.376650 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:19.376524    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:19.376650 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:19.376599    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:20.376583959 +0000 UTC m=+260.653826926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:19.376650 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:19.376529    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 00:10:19.376761 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:19.376691    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:20.376677582 +0000 UTC m=+260.653920568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : configmap "kube-rbac-proxy" not found
Jul 31 00:10:20.008469 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:20.008440    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:10:20.008909 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:20.008797    2582 scope.go:117] "RemoveContainer" containerID="ae7a8b937be7289c694d6a7a901f628504141d0b6caa2c17afb61a6e44e52773"
Jul 31 00:10:20.008987 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:20.008945    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-6jz89_openshift-console-operator(998b5748-05d2-49de-8e7f-ec06934bbffd)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" podUID="998b5748-05d2-49de-8e7f-ec06934bbffd"
Jul 31 00:10:20.383951 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:20.383862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:20.383951 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:20.383912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:20.384161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:20.384014    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:20.384161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:20.384037    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 00:10:20.384161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:20.384085    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.384070363 +0000 UTC m=+262.661313332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:20.384161 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:20.384104    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:22.38409125 +0000 UTC m=+262.661334216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : configmap "kube-rbac-proxy" not found
Jul 31 00:10:21.614042 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:21.614009    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqxgs_95d8d6a7-a733-4c80-8468-d3d27639d962/dns-node-resolver/0.log"
Jul 31 00:10:21.815085 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:21.815049    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29757600-j2grc_4214a0f7-ace1-4a6b-b45a-42e9edbb4bea/image-pruner/0.log"
Jul 31 00:10:22.394916 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:22.394820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:22.394916 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:22.394863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:22.395152 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:22.394995    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:22.395152 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:22.395063    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:26.39504379 +0000 UTC m=+266.672286762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:22.395384 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:22.395364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:22.496357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:22.496321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:22.496357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:22.496357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:22.496504 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:22.496459    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 00:10:22.496504 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:22.496490    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:30.496469149 +0000 UTC m=+270.773712118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : configmap references non-existent config key: service-ca.crt
Jul 31 00:10:22.496586 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:22.496515    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:30.496508451 +0000 UTC m=+270.773751417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : secret "router-metrics-certs-default" not found
Jul 31 00:10:22.813428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:22.813402    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smd62_efe2d439-2ef6-4a94-87fb-841d5be15612/node-ca/0.log"
Jul 31 00:10:23.413987 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:23.413953    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptks5_5af8df01-0684-4193-8bae-d83e5be683b8/serve-healthcheck-canary/0.log"
Jul 31 00:10:24.905211 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:24.905121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:24.905211 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:24.905172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:24.905590 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:24.905498    2582 scope.go:117] "RemoveContainer" containerID="ae7a8b937be7289c694d6a7a901f628504141d0b6caa2c17afb61a6e44e52773"
Jul 31 00:10:24.905710 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:24.905688    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-6jz89_openshift-console-operator(998b5748-05d2-49de-8e7f-ec06934bbffd)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" podUID="998b5748-05d2-49de-8e7f-ec06934bbffd"
Jul 31 00:10:26.430947 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:26.430904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:26.431332 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:26.431064    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:26.431332 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:26.431128    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls podName:ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be nodeName:}" failed. No retries permitted until 2026-07-31 00:10:34.43111207 +0000 UTC m=+274.708355041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tx87b" (UID: "ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be") : secret "insights-runtime-extractor-tls" not found
Jul 31 00:10:30.564123 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:30.564079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:30.564123 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:30.564123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:30.564558 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:30.564256    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle podName:80cf608c-b8d4-41a4-96df-41d4f0e9654a nodeName:}" failed. No retries permitted until 2026-07-31 00:10:46.564238393 +0000 UTC m=+286.841481361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle") pod "router-default-689c4fc56b-qgjfq" (UID: "80cf608c-b8d4-41a4-96df-41d4f0e9654a") : configmap references non-existent config key: service-ca.crt
Jul 31 00:10:30.566429 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:30.566407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80cf608c-b8d4-41a4-96df-41d4f0e9654a-metrics-certs\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:34.494829 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:34.494783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:34.497187 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:34.497164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tx87b\" (UID: \"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be\") " pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:34.565392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:34.565359    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tx87b"
Jul 31 00:10:34.690771 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:34.690747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tx87b"]
Jul 31 00:10:34.693433 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:34.693405    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd9a01a_63b1_4ffe_84bb_4c7c61aee2be.slice/crio-ba609a942a3079249d1901c434220145602d58807da82055952443815b78d4a7 WatchSource:0}: Error finding container ba609a942a3079249d1901c434220145602d58807da82055952443815b78d4a7: Status 404 returned error can't find the container with id ba609a942a3079249d1901c434220145602d58807da82055952443815b78d4a7
Jul 31 00:10:35.052907 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:35.052872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tx87b" event={"ID":"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be","Type":"ContainerStarted","Data":"c20567149de3f656d21db1a3f766565066a9e8fc632c165997ef81c5ff70b323"}
Jul 31 00:10:35.053088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:35.052936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tx87b" event={"ID":"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be","Type":"ContainerStarted","Data":"ba609a942a3079249d1901c434220145602d58807da82055952443815b78d4a7"}
Jul 31 00:10:36.057713 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:36.057677    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tx87b" event={"ID":"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be","Type":"ContainerStarted","Data":"c776c8eac6c03f2b82c0c6f3175149e1ec612a6b1e38eddaa82d9aa645ffe54c"}
Jul 31 00:10:36.243039 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:36.242988    2582 scope.go:117] "RemoveContainer" containerID="ae7a8b937be7289c694d6a7a901f628504141d0b6caa2c17afb61a6e44e52773"
Jul 31 00:10:37.063890 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:37.063857    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:10:37.064323 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:37.063938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" event={"ID":"998b5748-05d2-49de-8e7f-ec06934bbffd","Type":"ContainerStarted","Data":"c777225bb9c06ce6636d2ca0bd879e5dfae3dca0943b447a3b422d807d202ba1"}
Jul 31 00:10:37.064323 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:37.064246    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:37.082016 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:37.081946    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89" podStartSLOduration=20.45036266 podStartE2EDuration="23.081921479s" totalImagesPullingTime="2.631558819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:37.080235998 +0000 UTC m=+277.357478988" watchObservedRunningTime="2026-07-31 00:10:37.081921479 +0000 UTC m=+277.359164468"
Jul 31 00:10:37.255697 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:37.255668    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-6jz89"
Jul 31 00:10:38.069251 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:38.069212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tx87b" event={"ID":"ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be","Type":"ContainerStarted","Data":"e4860a5ceddd7425eb97056a68bdd53a47546fb4634f069527b34efb7e6986fc"}
Jul 31 00:10:38.088172 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:38.088118    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tx87b" podStartSLOduration=17.766561558 podStartE2EDuration="20.088096156s" totalImagesPullingTime="2.321534598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 00:10:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:38.087930739 +0000 UTC m=+278.365173729" watchObservedRunningTime="2026-07-31 00:10:38.088096156 +0000 UTC m=+278.365339146"
Jul 31 00:10:39.586499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.586460    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-gljgq"]
Jul 31 00:10:39.588413 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.588393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-gljgq"
Jul 31 00:10:39.590810 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.590788    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 00:10:39.591086 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.591063    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 00:10:39.591185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.591167    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mg76z\""
Jul 31 00:10:39.599755 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.599733    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-gljgq"]
Jul 31 00:10:39.637239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.637193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krl68\" (UniqueName: \"kubernetes.io/projected/0b929b13-ec94-475f-aff1-5f9a42f37175-kube-api-access-krl68\") pod \"downloads-77c974ffcf-gljgq\" (UID: \"0b929b13-ec94-475f-aff1-5f9a42f37175\") " pod="openshift-console/downloads-77c974ffcf-gljgq"
Jul 31 00:10:39.737901 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.737854    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krl68\" (UniqueName: \"kubernetes.io/projected/0b929b13-ec94-475f-aff1-5f9a42f37175-kube-api-access-krl68\") pod \"downloads-77c974ffcf-gljgq\" (UID: \"0b929b13-ec94-475f-aff1-5f9a42f37175\") " pod="openshift-console/downloads-77c974ffcf-gljgq"
Jul 31 00:10:39.748255 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.748217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krl68\" (UniqueName: \"kubernetes.io/projected/0b929b13-ec94-475f-aff1-5f9a42f37175-kube-api-access-krl68\") pod \"downloads-77c974ffcf-gljgq\" (UID: \"0b929b13-ec94-475f-aff1-5f9a42f37175\") " pod="openshift-console/downloads-77c974ffcf-gljgq"
Jul 31 00:10:39.897342 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:39.897252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-gljgq"
Jul 31 00:10:40.036315 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:40.036241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-gljgq"]
Jul 31 00:10:40.040026 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:40.039995    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b929b13_ec94_475f_aff1_5f9a42f37175.slice/crio-b32413db0b1ed0689a58eadabab7e1ab6393d35315cbbb6373ebc10ab22a9905 WatchSource:0}: Error finding container b32413db0b1ed0689a58eadabab7e1ab6393d35315cbbb6373ebc10ab22a9905: Status 404 returned error can't find the container with id b32413db0b1ed0689a58eadabab7e1ab6393d35315cbbb6373ebc10ab22a9905
Jul 31 00:10:40.077980 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:40.077945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-gljgq" event={"ID":"0b929b13-ec94-475f-aff1-5f9a42f37175","Type":"ContainerStarted","Data":"b32413db0b1ed0689a58eadabab7e1ab6393d35315cbbb6373ebc10ab22a9905"}
Jul 31 00:10:41.749974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:41.749926    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277"
Jul 31 00:10:41.749974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:41.749925    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb" podUID="be762795-9b56-40c0-ba08-0c27c20e465d"
Jul 31 00:10:41.749974 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:41.749926    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g5cl7" podUID="d5a84a2d-03b1-4dca-9812-1fab6279e254"
Jul 31 00:10:42.084592 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:42.084564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:10:42.084779 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:42.084564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:10:42.084779 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:42.084569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:10:45.483910 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.483861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:10:45.484398 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.483950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:10:45.484398 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.483988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:10:45.486858 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.486823    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5a84a2d-03b1-4dca-9812-1fab6279e254-metrics-tls\") pod \"dns-default-g5cl7\" (UID: \"d5a84a2d-03b1-4dca-9812-1fab6279e254\") " pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:10:45.487014 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.486882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/be762795-9b56-40c0-ba08-0c27c20e465d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8c2qb\" (UID: \"be762795-9b56-40c0-ba08-0c27c20e465d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:10:45.487014 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.486911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"image-registry-68bf5f746d-f5jzd\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") " pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:10:45.689571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.689536    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nnjn4\""
Jul 31 00:10:45.689571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.689538    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wdb2m\""
Jul 31 00:10:45.689827 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.689590    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p2wzq\""
Jul 31 00:10:45.696057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.696027    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"
Jul 31 00:10:45.696057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.696058    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:10:45.696296 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.696105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:10:45.863147 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.863079    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g5cl7"]
Jul 31 00:10:45.869735 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:45.869700    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a84a2d_03b1_4dca_9812_1fab6279e254.slice/crio-b8a8ecac452cd1376a4b86d8aaa83e0401a564b855db7f7724d4267fc3ce9f69 WatchSource:0}: Error finding container b8a8ecac452cd1376a4b86d8aaa83e0401a564b855db7f7724d4267fc3ce9f69: Status 404 returned error can't find the container with id b8a8ecac452cd1376a4b86d8aaa83e0401a564b855db7f7724d4267fc3ce9f69
Jul 31 00:10:45.874637 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.874599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb"]
Jul 31 00:10:45.877809 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:45.877782    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe762795_9b56_40c0_ba08_0c27c20e465d.slice/crio-00074f199268502225132b14316998faafb0331209d621c0bdf9b0132c4de5c1 WatchSource:0}: Error finding container 00074f199268502225132b14316998faafb0331209d621c0bdf9b0132c4de5c1: Status 404 returned error can't find the container with id 00074f199268502225132b14316998faafb0331209d621c0bdf9b0132c4de5c1
Jul 31 00:10:45.897695 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:45.897673    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68bf5f746d-f5jzd"]
Jul 31 00:10:45.899803 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:45.899773    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b693ba4_32ca_4c1b_b98a_f8699e64b277.slice/crio-c5cc8e681d6fef4cb173aa59a6fce16e16fabd6baaba81c4148522fa62ae91bc WatchSource:0}: Error finding container c5cc8e681d6fef4cb173aa59a6fce16e16fabd6baaba81c4148522fa62ae91bc: Status 404 returned error can't find the container with id c5cc8e681d6fef4cb173aa59a6fce16e16fabd6baaba81c4148522fa62ae91bc
Jul 31 00:10:46.102249 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.101916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb" event={"ID":"be762795-9b56-40c0-ba08-0c27c20e465d","Type":"ContainerStarted","Data":"00074f199268502225132b14316998faafb0331209d621c0bdf9b0132c4de5c1"}
Jul 31 00:10:46.103813 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.103779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" event={"ID":"8b693ba4-32ca-4c1b-b98a-f8699e64b277","Type":"ContainerStarted","Data":"ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864"}
Jul 31 00:10:46.103960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.103836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" event={"ID":"8b693ba4-32ca-4c1b-b98a-f8699e64b277","Type":"ContainerStarted","Data":"c5cc8e681d6fef4cb173aa59a6fce16e16fabd6baaba81c4148522fa62ae91bc"}
Jul 31 00:10:46.103960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.103886    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:10:46.105409 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.105387    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5cl7" event={"ID":"d5a84a2d-03b1-4dca-9812-1fab6279e254","Type":"ContainerStarted","Data":"b8a8ecac452cd1376a4b86d8aaa83e0401a564b855db7f7724d4267fc3ce9f69"}
Jul 31 00:10:46.122443 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.122382    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" podStartSLOduration=286.122360689 podStartE2EDuration="4m46.122360689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:46.121487101 +0000 UTC m=+286.398730093" watchObservedRunningTime="2026-07-31 00:10:46.122360689 +0000 UTC m=+286.399603679"
Jul 31 00:10:46.594132 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.594055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:46.594959 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.594916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80cf608c-b8d4-41a4-96df-41d4f0e9654a-service-ca-bundle\") pod \"router-default-689c4fc56b-qgjfq\" (UID: \"80cf608c-b8d4-41a4-96df-41d4f0e9654a\") " pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:46.791009 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:46.790688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:47.285430 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:47.285376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-689c4fc56b-qgjfq"]
Jul 31 00:10:47.288278 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:47.288246    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80cf608c_b8d4_41a4_96df_41d4f0e9654a.slice/crio-774802618e290298ef1693f6b86487d90dec44d40ba65b9713337feee7bd1248 WatchSource:0}: Error finding container 774802618e290298ef1693f6b86487d90dec44d40ba65b9713337feee7bd1248: Status 404 returned error can't find the container with id 774802618e290298ef1693f6b86487d90dec44d40ba65b9713337feee7bd1248
Jul 31 00:10:48.116653 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:48.116238    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-689c4fc56b-qgjfq" event={"ID":"80cf608c-b8d4-41a4-96df-41d4f0e9654a","Type":"ContainerStarted","Data":"ba5a2bd017ac57b0ff95c4d30a134e105b75c133fdfe7402fd4fab2f3cbfa61c"}
Jul 31 00:10:48.116653 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:48.116304    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-689c4fc56b-qgjfq" event={"ID":"80cf608c-b8d4-41a4-96df-41d4f0e9654a","Type":"ContainerStarted","Data":"774802618e290298ef1693f6b86487d90dec44d40ba65b9713337feee7bd1248"}
Jul 31 00:10:48.117895 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:48.117867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb" event={"ID":"be762795-9b56-40c0-ba08-0c27c20e465d","Type":"ContainerStarted","Data":"87de05b138a0733ab488b85d6151661bfbc1d700472386837ecb00a3c1456a15"}
Jul 31 00:10:48.136371 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:48.136307    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-689c4fc56b-qgjfq" podStartSLOduration=34.136284319 podStartE2EDuration="34.136284319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:48.135375702 +0000 UTC m=+288.412618692" watchObservedRunningTime="2026-07-31 00:10:48.136284319 +0000 UTC m=+288.413527310"
Jul 31 00:10:48.152848 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:48.152780    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8c2qb" podStartSLOduration=268.867015974 podStartE2EDuration="4m30.15275781s" totalImagesPullingTime="1.285741836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:48.152437904 +0000 UTC m=+288.429680893" watchObservedRunningTime="2026-07-31 00:10:48.15275781 +0000 UTC m=+288.430000800"
Jul 31 00:10:48.791815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:48.791765    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:48.794902 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:48.794875    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:49.127350 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.127244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5cl7" event={"ID":"d5a84a2d-03b1-4dca-9812-1fab6279e254","Type":"ContainerStarted","Data":"f3a705cd0710478199ace90172c5bcaa6bc379f6964631999f026ef10b42c35b"}
Jul 31 00:10:49.127832 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.127359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g5cl7" event={"ID":"d5a84a2d-03b1-4dca-9812-1fab6279e254","Type":"ContainerStarted","Data":"d952e6faec91822085020c3eac6beb3fb15e6fc034cb51895e7c1db798bcae8f"}
Jul 31 00:10:49.127832 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.127406    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:10:49.127832 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.127457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:49.128797 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.128776    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-689c4fc56b-qgjfq"
Jul 31 00:10:49.144489 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.144435    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g5cl7" podStartSLOduration=251.751780778 podStartE2EDuration="4m14.144392482s" totalImagesPullingTime="2.392611704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:49.143565867 +0000 UTC m=+289.420808857" watchObservedRunningTime="2026-07-31 00:10:49.144392482 +0000 UTC m=+289.421635472"
Jul 31 00:10:49.794565 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.794529    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"]
Jul 31 00:10:49.796960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.796932    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"
Jul 31 00:10:49.799928 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.799681    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m78g7\""
Jul 31 00:10:49.799928 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.799804    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 31 00:10:49.805485 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.805412    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"]
Jul 31 00:10:49.922850 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:49.922811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00e626c1-bab3-47c4-ae44-5db90bdddbb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-8jlg5\" (UID: \"00e626c1-bab3-47c4-ae44-5db90bdddbb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"
Jul 31 00:10:50.024350 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:50.024310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00e626c1-bab3-47c4-ae44-5db90bdddbb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-8jlg5\" (UID: \"00e626c1-bab3-47c4-ae44-5db90bdddbb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"
Jul 31 00:10:50.027307 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:50.027279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00e626c1-bab3-47c4-ae44-5db90bdddbb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-8jlg5\" (UID: \"00e626c1-bab3-47c4-ae44-5db90bdddbb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"
Jul 31 00:10:50.108802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:50.108702    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"
Jul 31 00:10:50.253176 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:50.253143    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"]
Jul 31 00:10:50.256702 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:10:50.256672    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e626c1_bab3_47c4_ae44_5db90bdddbb4.slice/crio-0b487dbbed27954de1ff686688cdfd5d6060c5181279c3e0b8250ded217c40a3 WatchSource:0}: Error finding container 0b487dbbed27954de1ff686688cdfd5d6060c5181279c3e0b8250ded217c40a3: Status 404 returned error can't find the container with id 0b487dbbed27954de1ff686688cdfd5d6060c5181279c3e0b8250ded217c40a3
Jul 31 00:10:51.137346 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:51.137307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5" event={"ID":"00e626c1-bab3-47c4-ae44-5db90bdddbb4","Type":"ContainerStarted","Data":"0b487dbbed27954de1ff686688cdfd5d6060c5181279c3e0b8250ded217c40a3"}
Jul 31 00:10:53.244900 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:10:53.244854    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z98bc" podUID="29ae0441-1a78-4692-97ad-a2749a174cd3"
Jul 31 00:10:58.167839 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:58.167788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-gljgq" event={"ID":"0b929b13-ec94-475f-aff1-5f9a42f37175","Type":"ContainerStarted","Data":"26d379656ae5e5a80f7f88ed864b2c356c211dd56cfa88fddff971485156e318"}
Jul 31 00:10:58.168566 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:58.168198    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-gljgq"
Jul 31 00:10:58.188006 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:58.187938    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-gljgq" podStartSLOduration=1.573761117 podStartE2EDuration="19.187918424s" totalImagesPullingTime="17.614157307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:58.185206155 +0000 UTC m=+298.462449145" watchObservedRunningTime="2026-07-31 00:10:58.187918424 +0000 UTC m=+298.465161413"
Jul 31 00:10:58.188406 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:58.188381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-gljgq"
Jul 31 00:10:59.134809 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.134771    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g5cl7"
Jul 31 00:10:59.174524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.173846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5" event={"ID":"00e626c1-bab3-47c4-ae44-5db90bdddbb4","Type":"ContainerStarted","Data":"b48f89f327d9dfd8641ffe4c51612f9d910cc214f21f153d1677475db401c6d6"}
Jul 31 00:10:59.174524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.174138    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"
Jul 31 00:10:59.179530 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.179501    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5"
Jul 31 00:10:59.189832 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.189771    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-8jlg5" podStartSLOduration=2.001118122 podStartE2EDuration="10.189754925s" totalImagesPullingTime="8.188636803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:10:59.188127287 +0000 UTC m=+299.465370277" watchObservedRunningTime="2026-07-31 00:10:59.189754925 +0000 UTC m=+299.466997915"
Jul 31 00:10:59.847657 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.847607    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"]
Jul 31 00:10:59.867228 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.867192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"]
Jul 31 00:10:59.867384 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.867298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:10:59.870076 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.870039    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 00:10:59.870215 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.870039    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w65v6\""
Jul 31 00:10:59.871352 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.871290    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 00:10:59.871556 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.871535    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 31 00:10:59.871663 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.871534    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 31 00:10:59.871773 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:10:59.871538    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 00:11:00.014990 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.014954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ql5v\" (UniqueName: \"kubernetes.io/projected/3815dd76-5b55-472d-9c9a-2c2f82a52be1-kube-api-access-7ql5v\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.015167 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.015011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3815dd76-5b55-472d-9c9a-2c2f82a52be1-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.015167 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.015046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3815dd76-5b55-472d-9c9a-2c2f82a52be1-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.015167 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.015148    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3815dd76-5b55-472d-9c9a-2c2f82a52be1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.115597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.115514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ql5v\" (UniqueName: \"kubernetes.io/projected/3815dd76-5b55-472d-9c9a-2c2f82a52be1-kube-api-access-7ql5v\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.115597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.115577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3815dd76-5b55-472d-9c9a-2c2f82a52be1-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.115831 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.115602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3815dd76-5b55-472d-9c9a-2c2f82a52be1-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.115831 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.115691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3815dd76-5b55-472d-9c9a-2c2f82a52be1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.118354 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.118326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 31 00:11:00.118482 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.118327    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 31 00:11:00.118817 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.118783    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 00:11:00.124580 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.124547    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 00:11:00.133722 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.133696    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 00:11:00.139595 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.139566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3815dd76-5b55-472d-9c9a-2c2f82a52be1-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.142017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.141986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3815dd76-5b55-472d-9c9a-2c2f82a52be1-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.142655 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.142278    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3815dd76-5b55-472d-9c9a-2c2f82a52be1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.144930 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.144845    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ql5v\" (UniqueName: \"kubernetes.io/projected/3815dd76-5b55-472d-9c9a-2c2f82a52be1-kube-api-access-7ql5v\") pod \"prometheus-operator-758d7cb874-sdrxq\" (UID: \"3815dd76-5b55-472d-9c9a-2c2f82a52be1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.152070 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.151980    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:11:00.152714 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.152692    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:11:00.165798 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.165772    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:11:00.165947 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.165821    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:11:00.169830 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.169809    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 00:11:00.181383 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.181359    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w65v6\""
Jul 31 00:11:00.189524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.189495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"
Jul 31 00:11:00.614180 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:00.365022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-sdrxq"]
Jul 31 00:11:00.614180 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:11:00.367991    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3815dd76_5b55_472d_9c9a_2c2f82a52be1.slice/crio-20c04568ee21d47aeb9ef56829cdb89a802b6413fff18c74de0945860da214da WatchSource:0}: Error finding container 20c04568ee21d47aeb9ef56829cdb89a802b6413fff18c74de0945860da214da: Status 404 returned error can't find the container with id 20c04568ee21d47aeb9ef56829cdb89a802b6413fff18c74de0945860da214da
Jul 31 00:11:01.183456 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:01.183410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq" event={"ID":"3815dd76-5b55-472d-9c9a-2c2f82a52be1","Type":"ContainerStarted","Data":"20c04568ee21d47aeb9ef56829cdb89a802b6413fff18c74de0945860da214da"}
Jul 31 00:11:01.654672 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:01.654612    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68bf5f746d-f5jzd"]
Jul 31 00:11:01.660294 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:01.660150    2582 patch_prober.go:28] interesting pod/image-registry-68bf5f746d-f5jzd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 00:11:01.660294 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:01.660209    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 00:11:03.198495 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:03.198448    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq" event={"ID":"3815dd76-5b55-472d-9c9a-2c2f82a52be1","Type":"ContainerStarted","Data":"4d00703a0b05df0a5afc744f7780f9e3f635dea7f3b0e39c8d947ab0576fddb2"}
Jul 31 00:11:03.198968 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:03.198551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq" event={"ID":"3815dd76-5b55-472d-9c9a-2c2f82a52be1","Type":"ContainerStarted","Data":"4fce0ad57499867e0cc803480b5cb14ad8f96a111e4a28b69e97f8ad7280e148"}
Jul 31 00:11:03.214716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:03.214664    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-sdrxq" podStartSLOduration=2.144129545 podStartE2EDuration="4.214647319s" totalImagesPullingTime="2.070517774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:03.213792366 +0000 UTC m=+303.491035357" watchObservedRunningTime="2026-07-31 00:11:03.214647319 +0000 UTC m=+303.491890302"
Jul 31 00:11:05.212138 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.212100    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"]
Jul 31 00:11:05.248572 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.248529    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bnqrr"]
Jul 31 00:11:05.248778 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.248688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.252946 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.252915    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 31 00:11:05.253122 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.252941    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-48zqt\""
Jul 31 00:11:05.253321 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.253302    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 31 00:11:05.253412 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.253334    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 31 00:11:05.292925 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.292880    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"]
Jul 31 00:11:05.293118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.293053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.295985 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.295944    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 00:11:05.296118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.295946    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 00:11:05.296195 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.296184    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 00:11:05.296599 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.296576    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r9g7t\""
Jul 31 00:11:05.366856 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.366816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crht4\" (UniqueName: \"kubernetes.io/projected/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-api-access-crht4\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.367032 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.366879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.367032 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.366950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97b5e3ec-aed7-4579-97cc-c770b618b957-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.367032 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.366998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.367172 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.367094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.367172 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.367150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/97b5e3ec-aed7-4579-97cc-c770b618b957-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.467687 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crht4\" (UniqueName: \"kubernetes.io/projected/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-api-access-crht4\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.467687 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.467687 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-textfile\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.467956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97b5e3ec-aed7-4579-97cc-c770b618b957-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.467956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.467956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.467956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-sys\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.467956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.467956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.467909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04d89f9-08e1-40a2-b952-016d227d70d5-metrics-client-ca\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.468256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-root\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.468256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.468256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6jwj\" (UniqueName: \"kubernetes.io/projected/e04d89f9-08e1-40a2-b952-016d227d70d5-kube-api-access-d6jwj\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.468256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-tls\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.468256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-wtmp\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.468256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/97b5e3ec-aed7-4579-97cc-c770b618b957-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.468556 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/97b5e3ec-aed7-4579-97cc-c770b618b957-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.468614 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468551    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97b5e3ec-aed7-4579-97cc-c770b618b957-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.468700 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.468609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.470847 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.470822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.471028 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.470998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.478360 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.478333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crht4\" (UniqueName: \"kubernetes.io/projected/97b5e3ec-aed7-4579-97cc-c770b618b957-kube-api-access-crht4\") pod \"kube-state-metrics-6bd9664c4-5ndmv\" (UID: \"97b5e3ec-aed7-4579-97cc-c770b618b957\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.560648 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.560588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"
Jul 31 00:11:05.568956 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.568915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-sys\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.568968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.568996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04d89f9-08e1-40a2-b952-016d227d70d5-metrics-client-ca\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-root\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-sys\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6jwj\" (UniqueName: \"kubernetes.io/projected/e04d89f9-08e1-40a2-b952-016d227d70d5-kube-api-access-d6jwj\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-tls\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-wtmp\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569158    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-root\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-textfile\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569666 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569512    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-wtmp\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.569842 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.569797    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-textfile\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.570026 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.570002    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.570177 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.570030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04d89f9-08e1-40a2-b952-016d227d70d5-metrics-client-ca\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.571808 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.571784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-tls\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.571914 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.571892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04d89f9-08e1-40a2-b952-016d227d70d5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.576910 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.576883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6jwj\" (UniqueName: \"kubernetes.io/projected/e04d89f9-08e1-40a2-b952-016d227d70d5-kube-api-access-d6jwj\") pod \"node-exporter-bnqrr\" (UID: \"e04d89f9-08e1-40a2-b952-016d227d70d5\") " pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.605151 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.605112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnqrr"
Jul 31 00:11:05.669016 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:11:05.668977    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04d89f9_08e1_40a2_b952_016d227d70d5.slice/crio-94009eedd35e6fe9382d7a2aca859eaf8a605425b9f5ba7135c35b78b5ed5f01 WatchSource:0}: Error finding container 94009eedd35e6fe9382d7a2aca859eaf8a605425b9f5ba7135c35b78b5ed5f01: Status 404 returned error can't find the container with id 94009eedd35e6fe9382d7a2aca859eaf8a605425b9f5ba7135c35b78b5ed5f01
Jul 31 00:11:05.673497 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.673470    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:11:05.757498 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:05.757465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv"]
Jul 31 00:11:05.760963 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:11:05.760931    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b5e3ec_aed7_4579_97cc_c770b618b957.slice/crio-98721e13563e214321ba7352c8c1872457b41763434eaa8f74ef2306078e7a99 WatchSource:0}: Error finding container 98721e13563e214321ba7352c8c1872457b41763434eaa8f74ef2306078e7a99: Status 404 returned error can't find the container with id 98721e13563e214321ba7352c8c1872457b41763434eaa8f74ef2306078e7a99
Jul 31 00:11:06.212115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.212021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv" event={"ID":"97b5e3ec-aed7-4579-97cc-c770b618b957","Type":"ContainerStarted","Data":"98721e13563e214321ba7352c8c1872457b41763434eaa8f74ef2306078e7a99"}
Jul 31 00:11:06.213640 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.213582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnqrr" event={"ID":"e04d89f9-08e1-40a2-b952-016d227d70d5","Type":"ContainerStarted","Data":"94009eedd35e6fe9382d7a2aca859eaf8a605425b9f5ba7135c35b78b5ed5f01"}
Jul 31 00:11:06.247357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.247322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:11:06.268548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.268515    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:11:06.291401 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.291366    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:11:06.291586 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.291553    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.294742 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.294715    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 31 00:11:06.294876 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.294762    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 31 00:11:06.295124 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.295105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 31 00:11:06.295651 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.295456    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-njdxv\""
Jul 31 00:11:06.295651 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.295531    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 31 00:11:06.295809 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.295778    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 31 00:11:06.296125 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.296103    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 31 00:11:06.296222 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.296165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 31 00:11:06.296691 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.296362    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 31 00:11:06.296691 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.296533    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdj2\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-kube-api-access-phdj2\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-config-out\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.479089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.477584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-web-config\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578199 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phdj2\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-kube-api-access-phdj2\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-config-out\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-web-config\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.578736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.578588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.579600 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.579571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.579742 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.579611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.580305 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.580280    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.583273 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.583248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.585425 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.584969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-web-config\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.585425 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.585344    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.585582 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.585550    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.586057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.586032    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-config-out\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.588107 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.588084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.588714 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.588694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdj2\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-kube-api-access-phdj2\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.589422 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.589398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.590320 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.590295    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.591964 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.591916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.606032 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.605992    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:11:06.826389 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:06.826355    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:11:07.061464 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:11:07.061396    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00978c35_d8b1_49ae_a744_4781d17acaf1.slice/crio-d30e1445c5874c785148fdbb93616133dcc899d8ce5698cfd02f84022dc5511a WatchSource:0}: Error finding container d30e1445c5874c785148fdbb93616133dcc899d8ce5698cfd02f84022dc5511a: Status 404 returned error can't find the container with id d30e1445c5874c785148fdbb93616133dcc899d8ce5698cfd02f84022dc5511a
Jul 31 00:11:07.219640 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:07.219582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerStarted","Data":"d30e1445c5874c785148fdbb93616133dcc899d8ce5698cfd02f84022dc5511a"}
Jul 31 00:11:08.224980 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:08.224950    2582 generic.go:356] "Generic (PLEG): container finished" podID="e04d89f9-08e1-40a2-b952-016d227d70d5" containerID="40ece593570bb19272551f7bf4a5d69774e7864b8f2ff77279821dbb7a593a82" exitCode=0
Jul 31 00:11:08.225431 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:08.225034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnqrr" event={"ID":"e04d89f9-08e1-40a2-b952-016d227d70d5","Type":"ContainerDied","Data":"40ece593570bb19272551f7bf4a5d69774e7864b8f2ff77279821dbb7a593a82"}
Jul 31 00:11:08.227589 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:08.227475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv" event={"ID":"97b5e3ec-aed7-4579-97cc-c770b618b957","Type":"ContainerStarted","Data":"f66cb407e82cbdd5c90818c91106f2c16ce8b213aa4563c95b8b122db295f339"}
Jul 31 00:11:08.227589 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:08.227549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv" event={"ID":"97b5e3ec-aed7-4579-97cc-c770b618b957","Type":"ContainerStarted","Data":"15cb3df8bb43a4025a5701411d06f84ea58ce00b395df38aa1ffded6364db0fc"}
Jul 31 00:11:09.233195 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:09.233102    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnqrr" event={"ID":"e04d89f9-08e1-40a2-b952-016d227d70d5","Type":"ContainerStarted","Data":"b28a2ec2ef07d644ec324e420c638eb54c6ed78a624113392ae6f83c8edd4d3c"}
Jul 31 00:11:09.233195 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:09.233169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnqrr" event={"ID":"e04d89f9-08e1-40a2-b952-016d227d70d5","Type":"ContainerStarted","Data":"c1d0408393a9d0feb95fcdb99cebd2f6210dd20e73850ec10dbbdaffb804adc1"}
Jul 31 00:11:09.235090 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:09.235066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv" event={"ID":"97b5e3ec-aed7-4579-97cc-c770b618b957","Type":"ContainerStarted","Data":"6925204e584b06ed4787331da02500a9722be8dfc64af150f3756501027a39c1"}
Jul 31 00:11:09.236589 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:09.236565    2582 generic.go:356] "Generic (PLEG): container finished" podID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerID="3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785" exitCode=0
Jul 31 00:11:09.236718 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:09.236640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785"}
Jul 31 00:11:09.250666 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:09.250598    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bnqrr" podStartSLOduration=1.902560175 podStartE2EDuration="4.25058454s" totalImagesPullingTime="2.224629205s" totalInitContainerRuntime="123.39516ms" isStatefulPod=true podCreationTimestamp="2026-07-31 00:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:09.249224824 +0000 UTC m=+309.526467813" watchObservedRunningTime="2026-07-31 00:11:09.25058454 +0000 UTC m=+309.527827554"
Jul 31 00:11:11.245394 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:11.245361    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerStarted","Data":"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"}
Jul 31 00:11:11.661255 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:11.661225    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:11:11.682084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:11.682035    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-5ndmv" podStartSLOduration=4.544878356 podStartE2EDuration="6.682015938s" totalImagesPullingTime="2.137137582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:09.296339885 +0000 UTC m=+309.573582876" watchObservedRunningTime="2026-07-31 00:11:11.682015938 +0000 UTC m=+311.959258926"
Jul 31 00:11:12.251880 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:12.251843    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerStarted","Data":"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"}
Jul 31 00:11:12.252335 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:12.251909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerStarted","Data":"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"}
Jul 31 00:11:12.252335 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:12.251935    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerStarted","Data":"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"}
Jul 31 00:11:12.252335 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:12.251957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerStarted","Data":"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"}
Jul 31 00:11:14.262031 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:14.261990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerStarted","Data":"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"}
Jul 31 00:11:14.289919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:14.289863    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.938332617 podStartE2EDuration="8.289844804s" totalImagesPullingTime="5.32406443s" totalInitContainerRuntime="27.447757ms" isStatefulPod=false podCreationTimestamp="2026-07-31 00:11:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:11:14.288056183 +0000 UTC m=+314.565299171" watchObservedRunningTime="2026-07-31 00:11:14.289844804 +0000 UTC m=+314.567087793"
Jul 31 00:11:26.679772 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:26.679697    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277" containerName="registry" containerID="cri-o://ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864" gracePeriod=30
Jul 31 00:11:26.952483 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:26.952406    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:11:27.058898 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.058858    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj9cm\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-kube-api-access-bj9cm\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.058898 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.058900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.059157 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.058922    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-trusted-ca\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.059157 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.058950    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b693ba4-32ca-4c1b-b98a-f8699e64b277-ca-trust-extracted\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.059157 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.059149    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-image-registry-private-configuration\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.059314 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.059194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-installation-pull-secrets\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.059314 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.059270    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-certificates\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.059314 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.059300    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-bound-sa-token\") pod \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\" (UID: \"8b693ba4-32ca-4c1b-b98a-f8699e64b277\") "
Jul 31 00:11:27.059469 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.059423    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:27.059702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.059682    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-trusted-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.059797 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.059733    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:27.061686 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.061610    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:27.061686 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.061616    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:27.061864 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.061752    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:11:27.062012 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.061991    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-kube-api-access-bj9cm" (OuterVolumeSpecName: "kube-api-access-bj9cm") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "kube-api-access-bj9cm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:27.062068 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.062009    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:11:27.068026 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.067999    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b693ba4-32ca-4c1b-b98a-f8699e64b277-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8b693ba4-32ca-4c1b-b98a-f8699e64b277" (UID: "8b693ba4-32ca-4c1b-b98a-f8699e64b277"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:11:27.161143 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.161103    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj9cm\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-kube-api-access-bj9cm\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.161143 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.161134    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.161357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.161144    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b693ba4-32ca-4c1b-b98a-f8699e64b277-ca-trust-extracted\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.161357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.161166    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-image-registry-private-configuration\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.161357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.161177    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b693ba4-32ca-4c1b-b98a-f8699e64b277-installation-pull-secrets\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.161357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.161186    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b693ba4-32ca-4c1b-b98a-f8699e64b277-registry-certificates\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.161357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.161195    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b693ba4-32ca-4c1b-b98a-f8699e64b277-bound-sa-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:27.313201 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.313167    2582 generic.go:356] "Generic (PLEG): container finished" podID="8b693ba4-32ca-4c1b-b98a-f8699e64b277" containerID="ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864" exitCode=0
Jul 31 00:11:27.313381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.313212    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd"
Jul 31 00:11:27.313381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.313253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" event={"ID":"8b693ba4-32ca-4c1b-b98a-f8699e64b277","Type":"ContainerDied","Data":"ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864"}
Jul 31 00:11:27.313381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.313303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bf5f746d-f5jzd" event={"ID":"8b693ba4-32ca-4c1b-b98a-f8699e64b277","Type":"ContainerDied","Data":"c5cc8e681d6fef4cb173aa59a6fce16e16fabd6baaba81c4148522fa62ae91bc"}
Jul 31 00:11:27.313381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.313325    2582 scope.go:117] "RemoveContainer" containerID="ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864"
Jul 31 00:11:27.322250 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.322232    2582 scope.go:117] "RemoveContainer" containerID="ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864"
Jul 31 00:11:27.322576 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:11:27.322556    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864\": container with ID starting with ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864 not found: ID does not exist" containerID="ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864"
Jul 31 00:11:27.322668 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.322587    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864"} err="failed to get container status \"ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864\": rpc error: code = NotFound desc = could not find container \"ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864\": container with ID starting with ae8bab77bfc645728758f0455c17131eac4c4495e2a048bb72895086b8262864 not found: ID does not exist"
Jul 31 00:11:27.334967 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.334933    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68bf5f746d-f5jzd"]
Jul 31 00:11:27.338345 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:27.338317    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68bf5f746d-f5jzd"]
Jul 31 00:11:28.248026 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:28.247991    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277" path="/var/lib/kubelet/pods/8b693ba4-32ca-4c1b-b98a-f8699e64b277/volumes"
Jul 31 00:11:37.352038 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:37.352002    2582 generic.go:356] "Generic (PLEG): container finished" podID="4214a0f7-ace1-4a6b-b45a-42e9edbb4bea" containerID="a0ab23529ad9251c4fc115236ccdcf3e9548f8bfacc1f38254c84794209c9d90" exitCode=0
Jul 31 00:11:37.352474 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:37.352076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29757600-j2grc" event={"ID":"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea","Type":"ContainerDied","Data":"a0ab23529ad9251c4fc115236ccdcf3e9548f8bfacc1f38254c84794209c9d90"}
Jul 31 00:11:38.503202 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:38.503165    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:11:38.655972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:38.655883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-serviceca\") pod \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") "
Jul 31 00:11:38.655972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:38.655932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7m44\" (UniqueName: \"kubernetes.io/projected/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-kube-api-access-r7m44\") pod \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\" (UID: \"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea\") "
Jul 31 00:11:38.656351 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:38.656325    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-serviceca" (OuterVolumeSpecName: "serviceca") pod "4214a0f7-ace1-4a6b-b45a-42e9edbb4bea" (UID: "4214a0f7-ace1-4a6b-b45a-42e9edbb4bea"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:11:38.658139 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:38.658116    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-kube-api-access-r7m44" (OuterVolumeSpecName: "kube-api-access-r7m44") pod "4214a0f7-ace1-4a6b-b45a-42e9edbb4bea" (UID: "4214a0f7-ace1-4a6b-b45a-42e9edbb4bea"). InnerVolumeSpecName "kube-api-access-r7m44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:11:38.756815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:38.756778    2582 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-serviceca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:38.756815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:38.756809    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7m44\" (UniqueName: \"kubernetes.io/projected/4214a0f7-ace1-4a6b-b45a-42e9edbb4bea-kube-api-access-r7m44\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:11:39.360118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:39.360078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29757600-j2grc" event={"ID":"4214a0f7-ace1-4a6b-b45a-42e9edbb4bea","Type":"ContainerDied","Data":"dfa47f46218e412f7b8b29046c40acd6ef77fba2895080c2838798b5b7223511"}
Jul 31 00:11:39.360118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:39.360107    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29757600-j2grc"
Jul 31 00:11:39.360322 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:39.360139    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfa47f46218e412f7b8b29046c40acd6ef77fba2895080c2838798b5b7223511"
Jul 31 00:11:43.376307 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:43.376275    2582 generic.go:356] "Generic (PLEG): container finished" podID="5edd60ed-3278-45f3-8eb8-9dcca014cf43" containerID="b7324c0f3bd54bf2447b6fd0f59a0289d78f5854fa201cb945bae0f7d44acb68" exitCode=0
Jul 31 00:11:43.376779 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:43.376355    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kjp2v" event={"ID":"5edd60ed-3278-45f3-8eb8-9dcca014cf43","Type":"ContainerDied","Data":"b7324c0f3bd54bf2447b6fd0f59a0289d78f5854fa201cb945bae0f7d44acb68"}
Jul 31 00:11:43.376779 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:43.376721    2582 scope.go:117] "RemoveContainer" containerID="b7324c0f3bd54bf2447b6fd0f59a0289d78f5854fa201cb945bae0f7d44acb68"
Jul 31 00:11:44.382235 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:11:44.382193    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kjp2v" event={"ID":"5edd60ed-3278-45f3-8eb8-9dcca014cf43","Type":"ContainerStarted","Data":"7cfe589ee71530f1fd4c5106b3d324b8025bb7fedb60b81e87b1c423aa39857c"}
Jul 31 00:12:13.250837 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:13.250792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:12:13.253133 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:13.253097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ae0441-1a78-4692-97ad-a2749a174cd3-metrics-certs\") pod \"network-metrics-daemon-z98bc\" (UID: \"29ae0441-1a78-4692-97ad-a2749a174cd3\") " pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:12:13.451106 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:13.451067    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tbfb2\""
Jul 31 00:12:13.458259 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:13.458228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z98bc"
Jul 31 00:12:13.588908 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:13.588884    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z98bc"]
Jul 31 00:12:13.590638 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:12:13.590597    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ae0441_1a78_4692_97ad_a2749a174cd3.slice/crio-2f6a1a25eb61ca1ed407fb20934bb9e0ffbac5dcc25c7958f9e2bc3cfa90a053 WatchSource:0}: Error finding container 2f6a1a25eb61ca1ed407fb20934bb9e0ffbac5dcc25c7958f9e2bc3cfa90a053: Status 404 returned error can't find the container with id 2f6a1a25eb61ca1ed407fb20934bb9e0ffbac5dcc25c7958f9e2bc3cfa90a053
Jul 31 00:12:14.497124 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:14.497088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z98bc" event={"ID":"29ae0441-1a78-4692-97ad-a2749a174cd3","Type":"ContainerStarted","Data":"2f6a1a25eb61ca1ed407fb20934bb9e0ffbac5dcc25c7958f9e2bc3cfa90a053"}
Jul 31 00:12:15.502318 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:15.502218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z98bc" event={"ID":"29ae0441-1a78-4692-97ad-a2749a174cd3","Type":"ContainerStarted","Data":"eca3e3492bda96cd4f3b6fb3eceafb19ea891be29aac84bab34b37a049500884"}
Jul 31 00:12:15.502696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:15.502320    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z98bc" event={"ID":"29ae0441-1a78-4692-97ad-a2749a174cd3","Type":"ContainerStarted","Data":"735ff56249104a95358fbb14e821c0023da93a2063589d6eaae640f22054dbcd"}
Jul 31 00:12:15.517339 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:15.517268    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z98bc" podStartSLOduration=373.877464136 podStartE2EDuration="6m15.517250991s" totalImagesPullingTime="1.639786855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:12:15.516980019 +0000 UTC m=+375.794223025" watchObservedRunningTime="2026-07-31 00:12:15.517250991 +0000 UTC m=+375.794493980"
Jul 31 00:12:25.464772 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:25.464736    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:12:25.465205 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:25.465014    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="alertmanager" containerID="cri-o://2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434" gracePeriod=120
Jul 31 00:12:25.465205 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:25.465081    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-metric" containerID="cri-o://e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445" gracePeriod=120
Jul 31 00:12:25.465205 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:25.465114    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-web" containerID="cri-o://25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e" gracePeriod=120
Jul 31 00:12:25.465205 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:25.465148    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="prom-label-proxy" containerID="cri-o://f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da" gracePeriod=120
Jul 31 00:12:25.465419 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:25.465176    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="config-reloader" containerID="cri-o://908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c" gracePeriod=120
Jul 31 00:12:25.465419 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:25.465153    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy" containerID="cri-o://941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e" gracePeriod=120
Jul 31 00:12:26.548570 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548527    2582 generic.go:356] "Generic (PLEG): container finished" podID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerID="f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da" exitCode=0
Jul 31 00:12:26.548570 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548557    2582 generic.go:356] "Generic (PLEG): container finished" podID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerID="941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e" exitCode=0
Jul 31 00:12:26.548570 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548563    2582 generic.go:356] "Generic (PLEG): container finished" podID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerID="908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c" exitCode=0
Jul 31 00:12:26.548570 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548569    2582 generic.go:356] "Generic (PLEG): container finished" podID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerID="2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434" exitCode=0
Jul 31 00:12:26.549017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"}
Jul 31 00:12:26.549017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548686    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"}
Jul 31 00:12:26.549017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548714    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"}
Jul 31 00:12:26.549017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.548739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"}
Jul 31 00:12:26.729365 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.729338    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:26.757081 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757081 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757075    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-cluster-tls-config\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757366 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-config-volume\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757366 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757142    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-metrics-client-ca\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757366 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757177    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-trusted-ca-bundle\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757366 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757205    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-web-config\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757729 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757695    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-main-tls\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757868 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757746    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-tls-assets\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757868 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757776    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-config-out\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757868 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.757868 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757809    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:26.757868 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757838    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.758502 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757890    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-main-db\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.758502 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.757937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phdj2\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-kube-api-access-phdj2\") pod \"00978c35-d8b1-49ae-a744-4781d17acaf1\" (UID: \"00978c35-d8b1-49ae-a744-4781d17acaf1\") "
Jul 31 00:12:26.759095 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.758798    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.759095 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.758905    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:12:26.759672 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.759611    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:12:26.760897 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.760859    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:26.762590 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.762196    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:12:26.762590 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.762472    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:26.762590 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.762562    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-kube-api-access-phdj2" (OuterVolumeSpecName: "kube-api-access-phdj2") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "kube-api-access-phdj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:12:26.762897 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.762868    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:26.763546 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.763262    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-config-out" (OuterVolumeSpecName: "config-out") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:12:26.765289 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.765265    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:26.765376 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.765289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-config-volume" (OuterVolumeSpecName: "config-volume") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:26.769402 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.769335    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:26.784015 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.783938    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-web-config" (OuterVolumeSpecName: "web-config") pod "00978c35-d8b1-49ae-a744-4781d17acaf1" (UID: "00978c35-d8b1-49ae-a744-4781d17acaf1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:12:26.859775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859731    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phdj2\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-kube-api-access-phdj2\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.859775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859765    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.859775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859775    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-cluster-tls-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.859775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859784    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-config-volume\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.859775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859793    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00978c35-d8b1-49ae-a744-4781d17acaf1-metrics-client-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.860066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859821    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-web-config\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.860066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859831    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-main-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.860066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859839    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00978c35-d8b1-49ae-a744-4781d17acaf1-tls-assets\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.860066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859847    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-config-out\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.860066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859855    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.860066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859865    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00978c35-d8b1-49ae-a744-4781d17acaf1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:26.860066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:26.859874    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00978c35-d8b1-49ae-a744-4781d17acaf1-alertmanager-main-db\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:12:27.557548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.557515    2582 generic.go:356] "Generic (PLEG): container finished" podID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerID="e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445" exitCode=0
Jul 31 00:12:27.557548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.557542    2582 generic.go:356] "Generic (PLEG): container finished" podID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerID="25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e" exitCode=0
Jul 31 00:12:27.558017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.557563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"}
Jul 31 00:12:27.558017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.557609    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.558017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.557648    2582 scope.go:117] "RemoveContainer" containerID="f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"
Jul 31 00:12:27.558017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.557635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"}
Jul 31 00:12:27.558017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.557784    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00978c35-d8b1-49ae-a744-4781d17acaf1","Type":"ContainerDied","Data":"d30e1445c5874c785148fdbb93616133dcc899d8ce5698cfd02f84022dc5511a"}
Jul 31 00:12:27.566142 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.566120    2582 scope.go:117] "RemoveContainer" containerID="e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"
Jul 31 00:12:27.573535 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.573515    2582 scope.go:117] "RemoveContainer" containerID="941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"
Jul 31 00:12:27.581278 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.580916    2582 scope.go:117] "RemoveContainer" containerID="25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"
Jul 31 00:12:27.582328 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.582307    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:12:27.586599 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.586576    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:12:27.589357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.589338    2582 scope.go:117] "RemoveContainer" containerID="908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"
Jul 31 00:12:27.596746 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.596726    2582 scope.go:117] "RemoveContainer" containerID="2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"
Jul 31 00:12:27.604366 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.604348    2582 scope.go:117] "RemoveContainer" containerID="3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785"
Jul 31 00:12:27.608485 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608459    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:12:27.608762 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608749    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608763    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608778    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-web"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608784    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-web"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608792    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4214a0f7-ace1-4a6b-b45a-42e9edbb4bea" containerName="image-pruner"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608798    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4214a0f7-ace1-4a6b-b45a-42e9edbb4bea" containerName="image-pruner"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608805    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="config-reloader"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608810    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="config-reloader"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608819    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="alertmanager"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608824    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="alertmanager"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608830    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="prom-label-proxy"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608835    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="prom-label-proxy"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608841    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277" containerName="registry"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608846    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277" containerName="registry"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608851    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="init-config-reloader"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608856    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="init-config-reloader"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608863    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-metric"
Jul 31 00:12:27.608862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608870    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-metric"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608928    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4214a0f7-ace1-4a6b-b45a-42e9edbb4bea" containerName="image-pruner"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608938    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="prom-label-proxy"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608948    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-web"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608960    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b693ba4-32ca-4c1b-b98a-f8699e64b277" containerName="registry"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608970    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608978    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="config-reloader"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608988    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="alertmanager"
Jul 31 00:12:27.609702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.608998    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" containerName="kube-rbac-proxy-metric"
Jul 31 00:12:27.612606 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.612576    2582 scope.go:117] "RemoveContainer" containerID="f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"
Jul 31 00:12:27.612771 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.612723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.613046 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:12:27.612936    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da\": container with ID starting with f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da not found: ID does not exist" containerID="f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"
Jul 31 00:12:27.613046 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.612973    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"} err="failed to get container status \"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da\": rpc error: code = NotFound desc = could not find container \"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da\": container with ID starting with f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da not found: ID does not exist"
Jul 31 00:12:27.613046 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.612998    2582 scope.go:117] "RemoveContainer" containerID="e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"
Jul 31 00:12:27.613315 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:12:27.613296    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445\": container with ID starting with e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445 not found: ID does not exist" containerID="e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"
Jul 31 00:12:27.613385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.613323    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"} err="failed to get container status \"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445\": rpc error: code = NotFound desc = could not find container \"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445\": container with ID starting with e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445 not found: ID does not exist"
Jul 31 00:12:27.613385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.613344    2582 scope.go:117] "RemoveContainer" containerID="941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"
Jul 31 00:12:27.613617 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:12:27.613598    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e\": container with ID starting with 941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e not found: ID does not exist" containerID="941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"
Jul 31 00:12:27.613706 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.613634    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"} err="failed to get container status \"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e\": rpc error: code = NotFound desc = could not find container \"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e\": container with ID starting with 941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e not found: ID does not exist"
Jul 31 00:12:27.613706 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.613654    2582 scope.go:117] "RemoveContainer" containerID="25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"
Jul 31 00:12:27.613943 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:12:27.613922    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e\": container with ID starting with 25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e not found: ID does not exist" containerID="25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"
Jul 31 00:12:27.613990 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.613951    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"} err="failed to get container status \"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e\": rpc error: code = NotFound desc = could not find container \"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e\": container with ID starting with 25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e not found: ID does not exist"
Jul 31 00:12:27.613990 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.613965    2582 scope.go:117] "RemoveContainer" containerID="908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"
Jul 31 00:12:27.614207 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:12:27.614189    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c\": container with ID starting with 908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c not found: ID does not exist" containerID="908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"
Jul 31 00:12:27.614310 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.614209    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"} err="failed to get container status \"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c\": rpc error: code = NotFound desc = could not find container \"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c\": container with ID starting with 908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c not found: ID does not exist"
Jul 31 00:12:27.614310 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.614222    2582 scope.go:117] "RemoveContainer" containerID="2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"
Jul 31 00:12:27.614595 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:12:27.614569    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434\": container with ID starting with 2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434 not found: ID does not exist" containerID="2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"
Jul 31 00:12:27.614666 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.614602    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"} err="failed to get container status \"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434\": rpc error: code = NotFound desc = could not find container \"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434\": container with ID starting with 2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434 not found: ID does not exist"
Jul 31 00:12:27.614666 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.614641    2582 scope.go:117] "RemoveContainer" containerID="3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785"
Jul 31 00:12:27.614957 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:12:27.614940    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785\": container with ID starting with 3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785 not found: ID does not exist" containerID="3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785"
Jul 31 00:12:27.615022 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.614964    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785"} err="failed to get container status \"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785\": rpc error: code = NotFound desc = could not find container \"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785\": container with ID starting with 3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785 not found: ID does not exist"
Jul 31 00:12:27.615022 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.614993    2582 scope.go:117] "RemoveContainer" containerID="f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"
Jul 31 00:12:27.615248 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615230    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da"} err="failed to get container status \"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da\": rpc error: code = NotFound desc = could not find container \"f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da\": container with ID starting with f0018c3874187add4494f4274df5e639600633f4f9fbc1b8692f42ff032ab1da not found: ID does not exist"
Jul 31 00:12:27.615295 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615249    2582 scope.go:117] "RemoveContainer" containerID="e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"
Jul 31 00:12:27.615470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615450    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 31 00:12:27.615558 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615499    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445"} err="failed to get container status \"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445\": rpc error: code = NotFound desc = could not find container \"e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445\": container with ID starting with e85663e34a14fdfc31f182fa29048d8e0013fc6de2593be30b977ef1e998e445 not found: ID does not exist"
Jul 31 00:12:27.615558 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615517    2582 scope.go:117] "RemoveContainer" containerID="941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"
Jul 31 00:12:27.615558 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615450    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 31 00:12:27.615833 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615800    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 31 00:12:27.615833 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615811    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 31 00:12:27.615957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615832    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 31 00:12:27.615957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 31 00:12:27.615957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615833    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 31 00:12:27.616106 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.615983    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e"} err="failed to get container status \"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e\": rpc error: code = NotFound desc = could not find container \"941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e\": container with ID starting with 941d5e4cc89c9584660c6fc69ffc55d5697a2c23fadca80213f727c31a2eaf4e not found: ID does not exist"
Jul 31 00:12:27.616106 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616004    2582 scope.go:117] "RemoveContainer" containerID="25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"
Jul 31 00:12:27.616251 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616229    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 31 00:12:27.616314 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616286    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e"} err="failed to get container status \"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e\": rpc error: code = NotFound desc = could not find container \"25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e\": container with ID starting with 25a9cbd1b20dc04095e8c7330edc711626a49a45b187da900be78e9c6da28f1e not found: ID does not exist"
Jul 31 00:12:27.616371 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616316    2582 scope.go:117] "RemoveContainer" containerID="908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"
Jul 31 00:12:27.616524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616506    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-njdxv\""
Jul 31 00:12:27.616640 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616556    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c"} err="failed to get container status \"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c\": rpc error: code = NotFound desc = could not find container \"908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c\": container with ID starting with 908ffc6fea4448b58cc09c458d0629f0a5116e4ac7bcec8bbd5914f227bb8c4c not found: ID does not exist"
Jul 31 00:12:27.616721 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616638    2582 scope.go:117] "RemoveContainer" containerID="2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"
Jul 31 00:12:27.616946 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616925    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434"} err="failed to get container status \"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434\": rpc error: code = NotFound desc = could not find container \"2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434\": container with ID starting with 2d099b07500f278e8426a70fd78e8460271db4cd6da9e88928b0fc8416076434 not found: ID does not exist"
Jul 31 00:12:27.617028 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.616949    2582 scope.go:117] "RemoveContainer" containerID="3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785"
Jul 31 00:12:27.617224 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.617206    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785"} err="failed to get container status \"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785\": rpc error: code = NotFound desc = could not find container \"3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785\": container with ID starting with 3d5724ef8e80300629c50132df72af05416f9b712bc036dbe3518ed094848785 not found: ID does not exist"
Jul 31 00:12:27.620348 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.620326    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 31 00:12:27.628045 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.628013    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:12:27.665168 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-config-out\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665168 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-web-config\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-config-volume\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkfs4\" (UniqueName: \"kubernetes.io/projected/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-kube-api-access-hkfs4\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665444 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665749 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.665749 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.665502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766277 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766277 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-config-out\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-web-config\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-config-volume\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkfs4\" (UniqueName: \"kubernetes.io/projected/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-kube-api-access-hkfs4\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.766960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.766795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.767492 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.767462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.768134 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.768104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.769561 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.769537    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.769921 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.769895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-config-out\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.770052 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.770034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-config-volume\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.770139 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.770107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-web-config\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.770721 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.770188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.770721 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.770315    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.770721 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.770354    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.770721 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.770609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.771261 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.771243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.775688 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.775666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkfs4\" (UniqueName: \"kubernetes.io/projected/fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15-kube-api-access-hkfs4\") pod \"alertmanager-main-0\" (UID: \"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:27.923006 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:27.922912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 00:12:28.060114 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:28.060087    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 00:12:28.062299 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:12:28.062263    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda8c7fa_4f3d_4023_8ebe_12f41b2e0f15.slice/crio-250d26efee750ba2f7b44a4d1662e7f6f3632693c20be233c26b16eadeccf925 WatchSource:0}: Error finding container 250d26efee750ba2f7b44a4d1662e7f6f3632693c20be233c26b16eadeccf925: Status 404 returned error can't find the container with id 250d26efee750ba2f7b44a4d1662e7f6f3632693c20be233c26b16eadeccf925
Jul 31 00:12:28.247494 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:28.247416    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00978c35-d8b1-49ae-a744-4781d17acaf1" path="/var/lib/kubelet/pods/00978c35-d8b1-49ae-a744-4781d17acaf1/volumes"
Jul 31 00:12:28.562660 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:28.562602    2582 generic.go:356] "Generic (PLEG): container finished" podID="fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15" containerID="64d23679f0781100f6f4b7d8c731762803e71d5084be5be36c68c45cd30ac9b6" exitCode=0
Jul 31 00:12:28.563091 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:28.562695    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerDied","Data":"64d23679f0781100f6f4b7d8c731762803e71d5084be5be36c68c45cd30ac9b6"}
Jul 31 00:12:28.563157 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:28.563095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerStarted","Data":"250d26efee750ba2f7b44a4d1662e7f6f3632693c20be233c26b16eadeccf925"}
Jul 31 00:12:29.447051 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.446994    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-757666fc54-shgn6"]
Jul 31 00:12:29.450074 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.450045    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.452643 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.452601    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 31 00:12:29.453239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.453217    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 31 00:12:29.453370 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.453286    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 31 00:12:29.453519 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.453504    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 31 00:12:29.453519 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.453514    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 31 00:12:29.453667 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.453607    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qnmg2\""
Jul 31 00:12:29.458060 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.458037    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 31 00:12:29.464935 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.464846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-757666fc54-shgn6"]
Jul 31 00:12:29.482352 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-federate-client-tls\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.482518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-metrics-client-ca\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.482518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6hng\" (UniqueName: \"kubernetes.io/projected/01a5a64d-c57b-4216-a65f-f8e1ad514402-kube-api-access-v6hng\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.482518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-telemeter-client-tls\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.482677 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.482677 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-telemeter-trusted-ca-bundle\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.482677 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-serving-certs-ca-bundle\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.482677 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.482657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-secret-telemeter-client\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.577307 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.577265    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerStarted","Data":"3f2f8b4d7a21bfa4a8520373d1732e33a80ae8e1c873ea439e0132217ecae182"}
Jul 31 00:12:29.577853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.577351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerStarted","Data":"f5eec36aa0f68477b7765ce40c5598d19dacedd8d144036e1b36332d365ff08c"}
Jul 31 00:12:29.577853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.577393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerStarted","Data":"78dbfd98b4fe369195f6ade216014fbbd005ee09ce5605e532ce9fe2d3a49305"}
Jul 31 00:12:29.577853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.577435    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerStarted","Data":"441e07b12b7afb3adb2894dc209d64deadaca1894d1eb6f81f8d3af9b598fbd8"}
Jul 31 00:12:29.577853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.577471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerStarted","Data":"74526975e4a767e18b51520bb93605444e92103fb4192a64bfe2276b6d46d433"}
Jul 31 00:12:29.577853 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.577505    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15","Type":"ContainerStarted","Data":"8b64726440f44a8eba952159f57b687eeffb35b9bcc0e9e572e2d0ce3502f1b6"}
Jul 31 00:12:29.583364 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.583553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-telemeter-trusted-ca-bundle\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.583553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-serving-certs-ca-bundle\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.583553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-secret-telemeter-client\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.583553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-federate-client-tls\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.583553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-metrics-client-ca\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.583553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6hng\" (UniqueName: \"kubernetes.io/projected/01a5a64d-c57b-4216-a65f-f8e1ad514402-kube-api-access-v6hng\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.584210 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.583916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-telemeter-client-tls\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.584472 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.584321    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-serving-certs-ca-bundle\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.584472 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.584428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-metrics-client-ca\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.584759 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.584709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01a5a64d-c57b-4216-a65f-f8e1ad514402-telemeter-trusted-ca-bundle\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.587575 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.586423    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-federate-client-tls\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.587575 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.586943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-secret-telemeter-client\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.587575 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.587281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.588382 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.588358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/01a5a64d-c57b-4216-a65f-f8e1ad514402-telemeter-client-tls\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.590742 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.590713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6hng\" (UniqueName: \"kubernetes.io/projected/01a5a64d-c57b-4216-a65f-f8e1ad514402-kube-api-access-v6hng\") pod \"telemeter-client-757666fc54-shgn6\" (UID: \"01a5a64d-c57b-4216-a65f-f8e1ad514402\") " pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.602370 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.602313    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.584536436 podStartE2EDuration="2.602294773s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.758337ms" isStatefulPod=false podCreationTimestamp="2026-07-31 00:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:12:29.600493507 +0000 UTC m=+389.877736607" watchObservedRunningTime="2026-07-31 00:12:29.602294773 +0000 UTC m=+389.879537828"
Jul 31 00:12:29.763546 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.763501    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-757666fc54-shgn6"
Jul 31 00:12:29.938065 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:29.938037    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-757666fc54-shgn6"]
Jul 31 00:12:29.940237 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:12:29.940207    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a5a64d_c57b_4216_a65f_f8e1ad514402.slice/crio-1bd2d5c369df53f5cfe36a39a918ee84426e17d1ce2f1e8bec7968ad48732a50 WatchSource:0}: Error finding container 1bd2d5c369df53f5cfe36a39a918ee84426e17d1ce2f1e8bec7968ad48732a50: Status 404 returned error can't find the container with id 1bd2d5c369df53f5cfe36a39a918ee84426e17d1ce2f1e8bec7968ad48732a50
Jul 31 00:12:30.583161 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:30.583121    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757666fc54-shgn6" event={"ID":"01a5a64d-c57b-4216-a65f-f8e1ad514402","Type":"ContainerStarted","Data":"1bd2d5c369df53f5cfe36a39a918ee84426e17d1ce2f1e8bec7968ad48732a50"}
Jul 31 00:12:33.598802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:33.598761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757666fc54-shgn6" event={"ID":"01a5a64d-c57b-4216-a65f-f8e1ad514402","Type":"ContainerStarted","Data":"65820721086d071bfc3e3a9ef117c3eed6e8b6a6684a868b23bd93a1f94af3c7"}
Jul 31 00:12:33.599188 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:33.598827    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757666fc54-shgn6" event={"ID":"01a5a64d-c57b-4216-a65f-f8e1ad514402","Type":"ContainerStarted","Data":"2ec33c5c078a7e35c602948ea5ff200abb4edb642d8402bf8356864df5e1a9a0"}
Jul 31 00:12:33.599188 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:33.598853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757666fc54-shgn6" event={"ID":"01a5a64d-c57b-4216-a65f-f8e1ad514402","Type":"ContainerStarted","Data":"c5c1adbb18f510cbcf03425a0e3d5424c7626c3038598bb95d336c91a1aefbb7"}
Jul 31 00:12:33.621700 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:12:33.621641    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-757666fc54-shgn6" podStartSLOduration=1.734119312 podStartE2EDuration="4.621608601s" totalImagesPullingTime="2.887489289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:12:33.620445321 +0000 UTC m=+393.897688334" watchObservedRunningTime="2026-07-31 00:12:33.621608601 +0000 UTC m=+393.898851590"
Jul 31 00:14:35.510578 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.510536    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"]
Jul 31 00:14:35.514029 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.514006    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.517085 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.517043    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 00:14:35.517213 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.517102    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 00:14:35.518441 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.518419    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sfk5\""
Jul 31 00:14:35.522375 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.522352    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"]
Jul 31 00:14:35.631101 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.631060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.631279 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.631118    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzfv\" (UniqueName: \"kubernetes.io/projected/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-kube-api-access-kgzfv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.631279 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.631174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.731816 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.731766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.732009 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.731845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzfv\" (UniqueName: \"kubernetes.io/projected/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-kube-api-access-kgzfv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.732009 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.731894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.732182 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.732160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.732254 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.732233    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.740144 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.740119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzfv\" (UniqueName: \"kubernetes.io/projected/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-kube-api-access-kgzfv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.824305 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.824213    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:35.958680 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:35.958650    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"]
Jul 31 00:14:35.960772 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:14:35.960743    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f5f99e_4e1c_46d9_a191_8c6c8b7cd731.slice/crio-7f5e2ed5cba63a6cd1cb01572440daa0127e4dc80523ec8eb2a237585bde7a8a WatchSource:0}: Error finding container 7f5e2ed5cba63a6cd1cb01572440daa0127e4dc80523ec8eb2a237585bde7a8a: Status 404 returned error can't find the container with id 7f5e2ed5cba63a6cd1cb01572440daa0127e4dc80523ec8eb2a237585bde7a8a
Jul 31 00:14:36.071638 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:36.071594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d" event={"ID":"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731","Type":"ContainerStarted","Data":"7f5e2ed5cba63a6cd1cb01572440daa0127e4dc80523ec8eb2a237585bde7a8a"}
Jul 31 00:14:42.099501 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:42.099467    2582 generic.go:356] "Generic (PLEG): container finished" podID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerID="1a65f11fddaedcfa82699978644cbfd6c7e94e579d0bc7795f733a942f35f591" exitCode=0
Jul 31 00:14:42.099901 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:42.099531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d" event={"ID":"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731","Type":"ContainerDied","Data":"1a65f11fddaedcfa82699978644cbfd6c7e94e579d0bc7795f733a942f35f591"}
Jul 31 00:14:45.114081 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:45.114045    2582 generic.go:356] "Generic (PLEG): container finished" podID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerID="4172075fe2a758d3217216a30a63a5f5deb4c62932f7d5bdf37c12d0c1d767b1" exitCode=0
Jul 31 00:14:45.114433 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:45.114129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d" event={"ID":"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731","Type":"ContainerDied","Data":"4172075fe2a758d3217216a30a63a5f5deb4c62932f7d5bdf37c12d0c1d767b1"}
Jul 31 00:14:52.148598 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:52.148469    2582 generic.go:356] "Generic (PLEG): container finished" podID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerID="f251250e77a415c47aef1ef44864eef171a229d19cd940a75f6be34a86075bb0" exitCode=0
Jul 31 00:14:52.148598 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:52.148533    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d" event={"ID":"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731","Type":"ContainerDied","Data":"f251250e77a415c47aef1ef44864eef171a229d19cd940a75f6be34a86075bb0"}
Jul 31 00:14:53.285267 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.285240    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:53.398493 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.398452    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgzfv\" (UniqueName: \"kubernetes.io/projected/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-kube-api-access-kgzfv\") pod \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") "
Jul 31 00:14:53.398493 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.398502    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-bundle\") pod \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") "
Jul 31 00:14:53.398749 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.398535    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-util\") pod \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\" (UID: \"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731\") "
Jul 31 00:14:53.399319 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.399292    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-bundle" (OuterVolumeSpecName: "bundle") pod "23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" (UID: "23f5f99e-4e1c-46d9-a191-8c6c8b7cd731"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:14:53.401257 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.401236    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-kube-api-access-kgzfv" (OuterVolumeSpecName: "kube-api-access-kgzfv") pod "23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" (UID: "23f5f99e-4e1c-46d9-a191-8c6c8b7cd731"). InnerVolumeSpecName "kube-api-access-kgzfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:14:53.403655 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.403562    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-util" (OuterVolumeSpecName: "util") pod "23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" (UID: "23f5f99e-4e1c-46d9-a191-8c6c8b7cd731"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:14:53.499904 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.499858    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:14:53.499904 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.499893    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgzfv\" (UniqueName: \"kubernetes.io/projected/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-kube-api-access-kgzfv\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:14:53.499904 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:53.499906    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23f5f99e-4e1c-46d9-a191-8c6c8b7cd731-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:14:54.157839 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:54.157803    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d"
Jul 31 00:14:54.157839 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:54.157816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408xw4d" event={"ID":"23f5f99e-4e1c-46d9-a191-8c6c8b7cd731","Type":"ContainerDied","Data":"7f5e2ed5cba63a6cd1cb01572440daa0127e4dc80523ec8eb2a237585bde7a8a"}
Jul 31 00:14:54.158041 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:54.157859    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f5e2ed5cba63a6cd1cb01572440daa0127e4dc80523ec8eb2a237585bde7a8a"
Jul 31 00:14:58.416760 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.416730    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"]
Jul 31 00:14:58.417236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.417046    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerName="pull"
Jul 31 00:14:58.417236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.417068    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerName="pull"
Jul 31 00:14:58.417236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.417082    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerName="util"
Jul 31 00:14:58.417236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.417088    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerName="util"
Jul 31 00:14:58.417236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.417098    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerName="extract"
Jul 31 00:14:58.417236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.417104    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerName="extract"
Jul 31 00:14:58.417236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.417159    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f5f99e-4e1c-46d9-a191-8c6c8b7cd731" containerName="extract"
Jul 31 00:14:58.462550 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.462511    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"]
Jul 31 00:14:58.462740 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.462611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.465568 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.465541    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 31 00:14:58.465709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.465543    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:14:58.465709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.465645    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-sx7kr\""
Jul 31 00:14:58.646518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.646481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbvvx\" (UniqueName: \"kubernetes.io/projected/61adfbc4-042d-4874-a020-0aa41cdb0918-kube-api-access-sbvvx\") pod \"cert-manager-operator-controller-manager-55c444bf86-znzt8\" (UID: \"61adfbc4-042d-4874-a020-0aa41cdb0918\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.646733 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.646525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61adfbc4-042d-4874-a020-0aa41cdb0918-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-znzt8\" (UID: \"61adfbc4-042d-4874-a020-0aa41cdb0918\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.747649 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.747535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbvvx\" (UniqueName: \"kubernetes.io/projected/61adfbc4-042d-4874-a020-0aa41cdb0918-kube-api-access-sbvvx\") pod \"cert-manager-operator-controller-manager-55c444bf86-znzt8\" (UID: \"61adfbc4-042d-4874-a020-0aa41cdb0918\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.747649 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.747584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61adfbc4-042d-4874-a020-0aa41cdb0918-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-znzt8\" (UID: \"61adfbc4-042d-4874-a020-0aa41cdb0918\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.748056 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.748038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61adfbc4-042d-4874-a020-0aa41cdb0918-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-znzt8\" (UID: \"61adfbc4-042d-4874-a020-0aa41cdb0918\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.758056 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.758026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbvvx\" (UniqueName: \"kubernetes.io/projected/61adfbc4-042d-4874-a020-0aa41cdb0918-kube-api-access-sbvvx\") pod \"cert-manager-operator-controller-manager-55c444bf86-znzt8\" (UID: \"61adfbc4-042d-4874-a020-0aa41cdb0918\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.771999 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.771965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"
Jul 31 00:14:58.929092 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:58.929050    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8"]
Jul 31 00:14:58.931832 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:14:58.931801    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61adfbc4_042d_4874_a020_0aa41cdb0918.slice/crio-f330745ef86f90e688f85b1ce75c09d4e2a230888bc16dcc83b1315db3faabcc WatchSource:0}: Error finding container f330745ef86f90e688f85b1ce75c09d4e2a230888bc16dcc83b1315db3faabcc: Status 404 returned error can't find the container with id f330745ef86f90e688f85b1ce75c09d4e2a230888bc16dcc83b1315db3faabcc
Jul 31 00:14:59.184764 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:14:59.184726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8" event={"ID":"61adfbc4-042d-4874-a020-0aa41cdb0918","Type":"ContainerStarted","Data":"f330745ef86f90e688f85b1ce75c09d4e2a230888bc16dcc83b1315db3faabcc"}
Jul 31 00:15:02.200020 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.199979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8" event={"ID":"61adfbc4-042d-4874-a020-0aa41cdb0918","Type":"ContainerStarted","Data":"3ed34cbf2b28cd8d000fa8c926984bf442e420f40e8487c0a472f9805296a584"}
Jul 31 00:15:02.211290 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.211251    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7spr4"]
Jul 31 00:15:02.224677 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.224596    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-znzt8" podStartSLOduration=1.893822503 podStartE2EDuration="4.22457747s" totalImagesPullingTime="2.330754967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:02.222741666 +0000 UTC m=+542.499984656" watchObservedRunningTime="2026-07-31 00:15:02.22457747 +0000 UTC m=+542.501820460"
Jul 31 00:15:02.233381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.233341    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7spr4"]
Jul 31 00:15:02.233518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.233442    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.236120 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.236095    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 31 00:15:02.236279 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.236234    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 31 00:15:02.236279 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.236245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gslfl\""
Jul 31 00:15:02.383990 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.383952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxk8\" (UniqueName: \"kubernetes.io/projected/ca849f6d-16f6-4079-bea1-3858d91ad6a7-kube-api-access-4zxk8\") pod \"cert-manager-webhook-6486ffd997-7spr4\" (UID: \"ca849f6d-16f6-4079-bea1-3858d91ad6a7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.384202 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.384070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca849f6d-16f6-4079-bea1-3858d91ad6a7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7spr4\" (UID: \"ca849f6d-16f6-4079-bea1-3858d91ad6a7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.485142 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.485046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxk8\" (UniqueName: \"kubernetes.io/projected/ca849f6d-16f6-4079-bea1-3858d91ad6a7-kube-api-access-4zxk8\") pod \"cert-manager-webhook-6486ffd997-7spr4\" (UID: \"ca849f6d-16f6-4079-bea1-3858d91ad6a7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.485142 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.485114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca849f6d-16f6-4079-bea1-3858d91ad6a7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7spr4\" (UID: \"ca849f6d-16f6-4079-bea1-3858d91ad6a7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.497329 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.497290    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca849f6d-16f6-4079-bea1-3858d91ad6a7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7spr4\" (UID: \"ca849f6d-16f6-4079-bea1-3858d91ad6a7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.497470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.497368    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxk8\" (UniqueName: \"kubernetes.io/projected/ca849f6d-16f6-4079-bea1-3858d91ad6a7-kube-api-access-4zxk8\") pod \"cert-manager-webhook-6486ffd997-7spr4\" (UID: \"ca849f6d-16f6-4079-bea1-3858d91ad6a7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.558686 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.558649    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:02.761305 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.761281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7spr4"]
Jul 31 00:15:02.763209 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:15:02.763177    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca849f6d_16f6_4079_bea1_3858d91ad6a7.slice/crio-7a4489c69096d2759263fee498b6786d28d1288d84229a8a1cede8531ab87aaf WatchSource:0}: Error finding container 7a4489c69096d2759263fee498b6786d28d1288d84229a8a1cede8531ab87aaf: Status 404 returned error can't find the container with id 7a4489c69096d2759263fee498b6786d28d1288d84229a8a1cede8531ab87aaf
Jul 31 00:15:02.847667 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.847619    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"]
Jul 31 00:15:02.882989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.882951    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"]
Jul 31 00:15:02.883150 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.883089    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:02.885923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.885900    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sfk5\""
Jul 31 00:15:02.886082 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.885901    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 00:15:02.886082 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.885965    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 00:15:02.988854 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.988810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:02.988854 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.988853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch84z\" (UniqueName: \"kubernetes.io/projected/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-kube-api-access-ch84z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:02.989116 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:02.988998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.089764 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.089657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.089764 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.089718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.089764 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.089739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch84z\" (UniqueName: \"kubernetes.io/projected/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-kube-api-access-ch84z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.090052 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.090030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.090087 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.090063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.100068 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.100030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch84z\" (UniqueName: \"kubernetes.io/projected/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-kube-api-access-ch84z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.192816 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.192777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:03.210072 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.210031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4" event={"ID":"ca849f6d-16f6-4079-bea1-3858d91ad6a7","Type":"ContainerStarted","Data":"7a4489c69096d2759263fee498b6786d28d1288d84229a8a1cede8531ab87aaf"}
Jul 31 00:15:03.346080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:03.346048    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"]
Jul 31 00:15:03.348296 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:15:03.348269    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c8b398_81f5_4fd2_b0a8_b33c6927bd6d.slice/crio-cf1cb45a9aa0e81bc06d1017fc5526c4c5705e2cf928d281ffbbffd606c62a24 WatchSource:0}: Error finding container cf1cb45a9aa0e81bc06d1017fc5526c4c5705e2cf928d281ffbbffd606c62a24: Status 404 returned error can't find the container with id cf1cb45a9aa0e81bc06d1017fc5526c4c5705e2cf928d281ffbbffd606c62a24
Jul 31 00:15:04.216470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:04.216427    2582 generic.go:356] "Generic (PLEG): container finished" podID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerID="39cb2a668b9902fa73ee16174c3262ab248d408ce95a712f9cf40977b0c49cc1" exitCode=0
Jul 31 00:15:04.216885 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:04.216508    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj" event={"ID":"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d","Type":"ContainerDied","Data":"39cb2a668b9902fa73ee16174c3262ab248d408ce95a712f9cf40977b0c49cc1"}
Jul 31 00:15:04.216885 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:04.216551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj" event={"ID":"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d","Type":"ContainerStarted","Data":"cf1cb45a9aa0e81bc06d1017fc5526c4c5705e2cf928d281ffbbffd606c62a24"}
Jul 31 00:15:07.234364 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:07.234314    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4" event={"ID":"ca849f6d-16f6-4079-bea1-3858d91ad6a7","Type":"ContainerStarted","Data":"6eeb9901f565aed98a62546b0c19a456f26bedecf64e9346019d9027cb90bdc1"}
Jul 31 00:15:07.234830 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:07.234507    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:07.250618 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:07.250558    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4" podStartSLOduration=1.371801868 podStartE2EDuration="5.250537362s" totalImagesPullingTime="3.878735494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:07.249450507 +0000 UTC m=+547.526693497" watchObservedRunningTime="2026-07-31 00:15:07.250537362 +0000 UTC m=+547.527780353"
Jul 31 00:15:08.241200 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:08.241166    2582 generic.go:356] "Generic (PLEG): container finished" podID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerID="14724a873f568078f20d2036e9c2aa4e9a4644885ea6dc39ab95386beb785072" exitCode=0
Jul 31 00:15:08.241579 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:08.241201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj" event={"ID":"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d","Type":"ContainerDied","Data":"14724a873f568078f20d2036e9c2aa4e9a4644885ea6dc39ab95386beb785072"}
Jul 31 00:15:09.248287 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:09.248251    2582 generic.go:356] "Generic (PLEG): container finished" podID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerID="28a3dc908f1e10c16043fbf5876204ddd91c96741bec1f98ebfcc2dfd7570a9d" exitCode=0
Jul 31 00:15:09.248691 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:09.248303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj" event={"ID":"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d","Type":"ContainerDied","Data":"28a3dc908f1e10c16043fbf5876204ddd91c96741bec1f98ebfcc2dfd7570a9d"}
Jul 31 00:15:10.382551 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.382520    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:10.450241 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.450199    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-bundle\") pod \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") "
Jul 31 00:15:10.450420 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.450266    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch84z\" (UniqueName: \"kubernetes.io/projected/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-kube-api-access-ch84z\") pod \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") "
Jul 31 00:15:10.450420 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.450295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-util\") pod \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\" (UID: \"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d\") "
Jul 31 00:15:10.450714 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.450691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-bundle" (OuterVolumeSpecName: "bundle") pod "b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" (UID: "b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:15:10.452424 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.452395    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-kube-api-access-ch84z" (OuterVolumeSpecName: "kube-api-access-ch84z") pod "b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" (UID: "b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d"). InnerVolumeSpecName "kube-api-access-ch84z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:15:10.454722 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.454681    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-util" (OuterVolumeSpecName: "util") pod "b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" (UID: "b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:15:10.551524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.551436    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:15:10.551524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.551470    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch84z\" (UniqueName: \"kubernetes.io/projected/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-kube-api-access-ch84z\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:15:10.551524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:10.551479    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:15:11.258146 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:11.258111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj" event={"ID":"b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d","Type":"ContainerDied","Data":"cf1cb45a9aa0e81bc06d1017fc5526c4c5705e2cf928d281ffbbffd606c62a24"}
Jul 31 00:15:11.258146 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:11.258132    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwcxcj"
Jul 31 00:15:11.258372 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:11.258166    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf1cb45a9aa0e81bc06d1017fc5526c4c5705e2cf928d281ffbbffd606c62a24"
Jul 31 00:15:13.243614 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:13.243580    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7spr4"
Jul 31 00:15:21.306441 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306406    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"]
Jul 31 00:15:21.306872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306732    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerName="extract"
Jul 31 00:15:21.306872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306744    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerName="extract"
Jul 31 00:15:21.306872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306759    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerName="util"
Jul 31 00:15:21.306872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306764    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerName="util"
Jul 31 00:15:21.306872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306774    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerName="pull"
Jul 31 00:15:21.306872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306779    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerName="pull"
Jul 31 00:15:21.306872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.306833    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c8b398-81f5-4fd2-b0a8-b33c6927bd6d" containerName="extract"
Jul 31 00:15:21.310401 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.310379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.312929 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.312894    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 00:15:21.313052 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.313010    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 00:15:21.314239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.314207    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8f7w8\""
Jul 31 00:15:21.317080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.317051    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"]
Jul 31 00:15:21.444039 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.443996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c9bdf79-48ed-461a-9a53-266a8cb687e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6sfkp\" (UID: \"9c9bdf79-48ed-461a-9a53-266a8cb687e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.444215 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.444069    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psfj9\" (UniqueName: \"kubernetes.io/projected/9c9bdf79-48ed-461a-9a53-266a8cb687e5-kube-api-access-psfj9\") pod \"openshift-lws-operator-fd8ccff4c-6sfkp\" (UID: \"9c9bdf79-48ed-461a-9a53-266a8cb687e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.544443 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.544415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psfj9\" (UniqueName: \"kubernetes.io/projected/9c9bdf79-48ed-461a-9a53-266a8cb687e5-kube-api-access-psfj9\") pod \"openshift-lws-operator-fd8ccff4c-6sfkp\" (UID: \"9c9bdf79-48ed-461a-9a53-266a8cb687e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.544576 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.544466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c9bdf79-48ed-461a-9a53-266a8cb687e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6sfkp\" (UID: \"9c9bdf79-48ed-461a-9a53-266a8cb687e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.544874 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.544855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c9bdf79-48ed-461a-9a53-266a8cb687e5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6sfkp\" (UID: \"9c9bdf79-48ed-461a-9a53-266a8cb687e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.553056 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.553031    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psfj9\" (UniqueName: \"kubernetes.io/projected/9c9bdf79-48ed-461a-9a53-266a8cb687e5-kube-api-access-psfj9\") pod \"openshift-lws-operator-fd8ccff4c-6sfkp\" (UID: \"9c9bdf79-48ed-461a-9a53-266a8cb687e5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.619845 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.619752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"
Jul 31 00:15:21.754546 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:21.754517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp"]
Jul 31 00:15:21.756921 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:15:21.756892    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c9bdf79_48ed_461a_9a53_266a8cb687e5.slice/crio-a6e12ad7b36fec8e46805204d8ea5cb9dd4ddd1c146e94a7f685ec07cd733136 WatchSource:0}: Error finding container a6e12ad7b36fec8e46805204d8ea5cb9dd4ddd1c146e94a7f685ec07cd733136: Status 404 returned error can't find the container with id a6e12ad7b36fec8e46805204d8ea5cb9dd4ddd1c146e94a7f685ec07cd733136
Jul 31 00:15:22.310067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.310030    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp" event={"ID":"9c9bdf79-48ed-461a-9a53-266a8cb687e5","Type":"ContainerStarted","Data":"a6e12ad7b36fec8e46805204d8ea5cb9dd4ddd1c146e94a7f685ec07cd733136"}
Jul 31 00:15:22.799878 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.799842    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kf2x7"]
Jul 31 00:15:22.803204 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.803185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:22.806243 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.806216    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k897d\""
Jul 31 00:15:22.823003 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.822968    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kf2x7"]
Jul 31 00:15:22.856099 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.856054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aed9a467-46fc-4cf3-ada5-7ac9f2ba94be-bound-sa-token\") pod \"cert-manager-55b4d954d5-kf2x7\" (UID: \"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be\") " pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:22.856281 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.856119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbmm\" (UniqueName: \"kubernetes.io/projected/aed9a467-46fc-4cf3-ada5-7ac9f2ba94be-kube-api-access-dfbmm\") pod \"cert-manager-55b4d954d5-kf2x7\" (UID: \"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be\") " pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:22.957435 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.957397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aed9a467-46fc-4cf3-ada5-7ac9f2ba94be-bound-sa-token\") pod \"cert-manager-55b4d954d5-kf2x7\" (UID: \"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be\") " pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:22.957661 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:22.957446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbmm\" (UniqueName: \"kubernetes.io/projected/aed9a467-46fc-4cf3-ada5-7ac9f2ba94be-kube-api-access-dfbmm\") pod \"cert-manager-55b4d954d5-kf2x7\" (UID: \"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be\") " pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:23.007031 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:23.006991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aed9a467-46fc-4cf3-ada5-7ac9f2ba94be-bound-sa-token\") pod \"cert-manager-55b4d954d5-kf2x7\" (UID: \"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be\") " pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:23.007031 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:23.007022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbmm\" (UniqueName: \"kubernetes.io/projected/aed9a467-46fc-4cf3-ada5-7ac9f2ba94be-kube-api-access-dfbmm\") pod \"cert-manager-55b4d954d5-kf2x7\" (UID: \"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be\") " pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:23.113485 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:23.113406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kf2x7"
Jul 31 00:15:23.687886 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:23.687861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kf2x7"]
Jul 31 00:15:23.691053 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:15:23.691027    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaed9a467_46fc_4cf3_ada5_7ac9f2ba94be.slice/crio-550590f9ca85b2a1d8fdd79a8e5a0bf9bf42a31f9505b5d943eafea2b49d303d WatchSource:0}: Error finding container 550590f9ca85b2a1d8fdd79a8e5a0bf9bf42a31f9505b5d943eafea2b49d303d: Status 404 returned error can't find the container with id 550590f9ca85b2a1d8fdd79a8e5a0bf9bf42a31f9505b5d943eafea2b49d303d
Jul 31 00:15:24.327411 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:24.327365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kf2x7" event={"ID":"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be","Type":"ContainerStarted","Data":"ebf3553fb4b08f400db790caeb32f5fa087ce44c233936ddef38c6fc9f93b0a1"}
Jul 31 00:15:24.327593 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:24.327423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kf2x7" event={"ID":"aed9a467-46fc-4cf3-ada5-7ac9f2ba94be","Type":"ContainerStarted","Data":"550590f9ca85b2a1d8fdd79a8e5a0bf9bf42a31f9505b5d943eafea2b49d303d"}
Jul 31 00:15:24.328953 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:24.328923    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp" event={"ID":"9c9bdf79-48ed-461a-9a53-266a8cb687e5","Type":"ContainerStarted","Data":"4bb44a36126046f93fd7a67f483bd0e46ee0b552f2f7c0c10d1f298b3d5395d2"}
Jul 31 00:15:24.343184 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:24.343125    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kf2x7" podStartSLOduration=2.343109587 podStartE2EDuration="2.343109587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:24.342241687 +0000 UTC m=+564.619484670" watchObservedRunningTime="2026-07-31 00:15:24.343109587 +0000 UTC m=+564.620352576"
Jul 31 00:15:24.369320 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:24.369260    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6sfkp" podStartSLOduration=1.503644253 podStartE2EDuration="3.369240604s" totalImagesPullingTime="1.865596351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:24.367799231 +0000 UTC m=+564.645042247" watchObservedRunningTime="2026-07-31 00:15:24.369240604 +0000 UTC m=+564.646483592"
Jul 31 00:15:31.753930 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.753891    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"]
Jul 31 00:15:31.757548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.757529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.760114 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.760088    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sfk5\""
Jul 31 00:15:31.760271 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.760153    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 00:15:31.761336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.761318    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 00:15:31.765658 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.765580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"]
Jul 31 00:15:31.836593 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.836553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.836593 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.836594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.836851 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.836613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djvt5\" (UniqueName: \"kubernetes.io/projected/ab229666-4967-4b92-85f4-4896ae03acf6-kube-api-access-djvt5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.937931 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.937888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.937931 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.937934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.938201 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.937955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djvt5\" (UniqueName: \"kubernetes.io/projected/ab229666-4967-4b92-85f4-4896ae03acf6-kube-api-access-djvt5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.938363 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.938339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.938401 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.938350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:31.946159 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:31.946129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djvt5\" (UniqueName: \"kubernetes.io/projected/ab229666-4967-4b92-85f4-4896ae03acf6-kube-api-access-djvt5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:32.068405 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:32.068305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:32.202399 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:32.202374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"]
Jul 31 00:15:32.204524 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:15:32.204489    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab229666_4967_4b92_85f4_4896ae03acf6.slice/crio-ad640f247466b27d75f30d07e74f7c4a15b3f9aea3362d3db1f341b14ccd4547 WatchSource:0}: Error finding container ad640f247466b27d75f30d07e74f7c4a15b3f9aea3362d3db1f341b14ccd4547: Status 404 returned error can't find the container with id ad640f247466b27d75f30d07e74f7c4a15b3f9aea3362d3db1f341b14ccd4547
Jul 31 00:15:32.367846 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:32.367759    2582 generic.go:356] "Generic (PLEG): container finished" podID="ab229666-4967-4b92-85f4-4896ae03acf6" containerID="0bbfa5d379db16cdc9c5c2c79f4f84f294b35b03e543f3caa44a4a552a8ed3e8" exitCode=0
Jul 31 00:15:32.368015 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:32.367844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg" event={"ID":"ab229666-4967-4b92-85f4-4896ae03acf6","Type":"ContainerDied","Data":"0bbfa5d379db16cdc9c5c2c79f4f84f294b35b03e543f3caa44a4a552a8ed3e8"}
Jul 31 00:15:32.368015 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:32.367895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg" event={"ID":"ab229666-4967-4b92-85f4-4896ae03acf6","Type":"ContainerStarted","Data":"ad640f247466b27d75f30d07e74f7c4a15b3f9aea3362d3db1f341b14ccd4547"}
Jul 31 00:15:33.375157 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:33.375124    2582 generic.go:356] "Generic (PLEG): container finished" podID="ab229666-4967-4b92-85f4-4896ae03acf6" containerID="ab107ee7daa2236c28b4f8e6d59aa357d21640b88eb95d602d4c247faeb1cb6d" exitCode=0
Jul 31 00:15:33.375552 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:33.375173    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg" event={"ID":"ab229666-4967-4b92-85f4-4896ae03acf6","Type":"ContainerDied","Data":"ab107ee7daa2236c28b4f8e6d59aa357d21640b88eb95d602d4c247faeb1cb6d"}
Jul 31 00:15:34.383122 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:34.383086    2582 generic.go:356] "Generic (PLEG): container finished" podID="ab229666-4967-4b92-85f4-4896ae03acf6" containerID="fd0b45489a3d21e58d8e34a861cd738f54d4ab94889ba05e7d1bf5a40e94f917" exitCode=0
Jul 31 00:15:34.383505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:34.383159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg" event={"ID":"ab229666-4967-4b92-85f4-4896ae03acf6","Type":"ContainerDied","Data":"fd0b45489a3d21e58d8e34a861cd738f54d4ab94889ba05e7d1bf5a40e94f917"}
Jul 31 00:15:35.536957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.536926    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:35.672568 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.672471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djvt5\" (UniqueName: \"kubernetes.io/projected/ab229666-4967-4b92-85f4-4896ae03acf6-kube-api-access-djvt5\") pod \"ab229666-4967-4b92-85f4-4896ae03acf6\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") "
Jul 31 00:15:35.672747 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.672591    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-bundle\") pod \"ab229666-4967-4b92-85f4-4896ae03acf6\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") "
Jul 31 00:15:35.672747 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.672608    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-util\") pod \"ab229666-4967-4b92-85f4-4896ae03acf6\" (UID: \"ab229666-4967-4b92-85f4-4896ae03acf6\") "
Jul 31 00:15:35.673495 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.673458    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-bundle" (OuterVolumeSpecName: "bundle") pod "ab229666-4967-4b92-85f4-4896ae03acf6" (UID: "ab229666-4967-4b92-85f4-4896ae03acf6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:15:35.674568 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.674546    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab229666-4967-4b92-85f4-4896ae03acf6-kube-api-access-djvt5" (OuterVolumeSpecName: "kube-api-access-djvt5") pod "ab229666-4967-4b92-85f4-4896ae03acf6" (UID: "ab229666-4967-4b92-85f4-4896ae03acf6"). InnerVolumeSpecName "kube-api-access-djvt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:15:35.678775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.678731    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-util" (OuterVolumeSpecName: "util") pod "ab229666-4967-4b92-85f4-4896ae03acf6" (UID: "ab229666-4967-4b92-85f4-4896ae03acf6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:15:35.773900 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.773861    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:15:35.773900 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.773892    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab229666-4967-4b92-85f4-4896ae03acf6-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:15:35.773900 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:35.773901    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djvt5\" (UniqueName: \"kubernetes.io/projected/ab229666-4967-4b92-85f4-4896ae03acf6-kube-api-access-djvt5\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:15:36.395885 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:36.395853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg" event={"ID":"ab229666-4967-4b92-85f4-4896ae03acf6","Type":"ContainerDied","Data":"ad640f247466b27d75f30d07e74f7c4a15b3f9aea3362d3db1f341b14ccd4547"}
Jul 31 00:15:36.395885 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:36.395884    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afll4cg"
Jul 31 00:15:36.396154 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:36.395904    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad640f247466b27d75f30d07e74f7c4a15b3f9aea3362d3db1f341b14ccd4547"
Jul 31 00:15:43.454499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454460    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"]
Jul 31 00:15:43.454989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454830    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab229666-4967-4b92-85f4-4896ae03acf6" containerName="extract"
Jul 31 00:15:43.454989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454844    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab229666-4967-4b92-85f4-4896ae03acf6" containerName="extract"
Jul 31 00:15:43.454989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454865    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab229666-4967-4b92-85f4-4896ae03acf6" containerName="pull"
Jul 31 00:15:43.454989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454871    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab229666-4967-4b92-85f4-4896ae03acf6" containerName="pull"
Jul 31 00:15:43.454989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454881    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab229666-4967-4b92-85f4-4896ae03acf6" containerName="util"
Jul 31 00:15:43.454989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454887    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab229666-4967-4b92-85f4-4896ae03acf6" containerName="util"
Jul 31 00:15:43.454989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.454954    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab229666-4967-4b92-85f4-4896ae03acf6" containerName="extract"
Jul 31 00:15:43.461457 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.461428    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.464078 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.464052    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 00:15:43.464388 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.464359    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 00:15:43.464509 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.464370    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 00:15:43.464579 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.464543    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 00:15:43.464654 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.464583    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nl6x5\""
Jul 31 00:15:43.484045 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.484012    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"]
Jul 31 00:15:43.541678 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.541614    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3215a728-10ce-46ee-bd0a-6c0cd100a38a-tmp\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.541877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.541695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3215a728-10ce-46ee-bd0a-6c0cd100a38a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.541877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.541787    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3215a728-10ce-46ee-bd0a-6c0cd100a38a-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.541877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.541811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf5tt\" (UniqueName: \"kubernetes.io/projected/3215a728-10ce-46ee-bd0a-6c0cd100a38a-kube-api-access-jf5tt\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.541877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.541836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3215a728-10ce-46ee-bd0a-6c0cd100a38a-manifests\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.643234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.643192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3215a728-10ce-46ee-bd0a-6c0cd100a38a-tmp\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.643234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.643236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3215a728-10ce-46ee-bd0a-6c0cd100a38a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.643442 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.643294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3215a728-10ce-46ee-bd0a-6c0cd100a38a-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.643442 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.643329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf5tt\" (UniqueName: \"kubernetes.io/projected/3215a728-10ce-46ee-bd0a-6c0cd100a38a-kube-api-access-jf5tt\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.643512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.643471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3215a728-10ce-46ee-bd0a-6c0cd100a38a-manifests\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.643858 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.643828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3215a728-10ce-46ee-bd0a-6c0cd100a38a-manifests\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.645700 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.645674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3215a728-10ce-46ee-bd0a-6c0cd100a38a-tmp\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.645803 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.645750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3215a728-10ce-46ee-bd0a-6c0cd100a38a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.646027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.646008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3215a728-10ce-46ee-bd0a-6c0cd100a38a-webhook-cert\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.668564 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.668530    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf5tt\" (UniqueName: \"kubernetes.io/projected/3215a728-10ce-46ee-bd0a-6c0cd100a38a-kube-api-access-jf5tt\") pod \"opendatahub-operator-controller-manager-bff98467-k7k5m\" (UID: \"3215a728-10ce-46ee-bd0a-6c0cd100a38a\") " pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.669781 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.669759    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"]
Jul 31 00:15:43.673231 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.673214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.677160 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.677138    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 00:15:43.677300 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.677215    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zfvld\""
Jul 31 00:15:43.677300 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.677273    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 00:15:43.677412 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.677320    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 00:15:43.706278 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.706170    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"]
Jul 31 00:15:43.772252 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.772215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:43.844570 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.844536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f441d567-6f29-41de-af2e-6fea61f23c7d-manager-config\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.844732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.844577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5d54\" (UniqueName: \"kubernetes.io/projected/f441d567-6f29-41de-af2e-6fea61f23c7d-kube-api-access-q5d54\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.844787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.844724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f441d567-6f29-41de-af2e-6fea61f23c7d-metrics-cert\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.844787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.844779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f441d567-6f29-41de-af2e-6fea61f23c7d-cert\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.920159 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.920133    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"]
Jul 31 00:15:43.921911 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:15:43.921880    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3215a728_10ce_46ee_bd0a_6c0cd100a38a.slice/crio-0d1bfa3e52f1c7ee8a50b66e5809ca7d1797239b9730e3a111e50dc5330a0437 WatchSource:0}: Error finding container 0d1bfa3e52f1c7ee8a50b66e5809ca7d1797239b9730e3a111e50dc5330a0437: Status 404 returned error can't find the container with id 0d1bfa3e52f1c7ee8a50b66e5809ca7d1797239b9730e3a111e50dc5330a0437
Jul 31 00:15:43.946092 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.946054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f441d567-6f29-41de-af2e-6fea61f23c7d-manager-config\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.946271 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.946100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5d54\" (UniqueName: \"kubernetes.io/projected/f441d567-6f29-41de-af2e-6fea61f23c7d-kube-api-access-q5d54\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.946271 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.946140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f441d567-6f29-41de-af2e-6fea61f23c7d-metrics-cert\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.946271 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.946174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f441d567-6f29-41de-af2e-6fea61f23c7d-cert\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.946737 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.946715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f441d567-6f29-41de-af2e-6fea61f23c7d-manager-config\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.948698 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.948675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f441d567-6f29-41de-af2e-6fea61f23c7d-cert\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.948808 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.948776    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f441d567-6f29-41de-af2e-6fea61f23c7d-metrics-cert\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.955993 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.955964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5d54\" (UniqueName: \"kubernetes.io/projected/f441d567-6f29-41de-af2e-6fea61f23c7d-kube-api-access-q5d54\") pod \"lws-controller-manager-5dbc4bb7b6-4rrbw\" (UID: \"f441d567-6f29-41de-af2e-6fea61f23c7d\") " pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:43.983927 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:43.983835    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:44.149295 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:44.149254    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"]
Jul 31 00:15:44.435509 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:44.435462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m" event={"ID":"3215a728-10ce-46ee-bd0a-6c0cd100a38a","Type":"ContainerStarted","Data":"0d1bfa3e52f1c7ee8a50b66e5809ca7d1797239b9730e3a111e50dc5330a0437"}
Jul 31 00:15:44.436781 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:44.436751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw" event={"ID":"f441d567-6f29-41de-af2e-6fea61f23c7d","Type":"ContainerStarted","Data":"3b78bd87b23f368784f904e4cd1393d5dd369bd6c2e311ee1665670e965c2802"}
Jul 31 00:15:48.461810 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:48.461764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m" event={"ID":"3215a728-10ce-46ee-bd0a-6c0cd100a38a","Type":"ContainerStarted","Data":"797459b0d82db89de1aad4a87645c564f54514fcf6053861ec4a04afa49cf55d"}
Jul 31 00:15:48.463471 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:48.463445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw" event={"ID":"f441d567-6f29-41de-af2e-6fea61f23c7d","Type":"ContainerStarted","Data":"3f1172f3e252b694c389fa48046bbbcf22cb5487aeb9d9b2d592f444a18ffa9b"}
Jul 31 00:15:48.463597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:48.463508    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:15:48.496818 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:48.496764    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw" podStartSLOduration=2.162087326 podStartE2EDuration="5.496742957s" totalImagesPullingTime="3.334655631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:48.496065724 +0000 UTC m=+588.773308721" watchObservedRunningTime="2026-07-31 00:15:48.496742957 +0000 UTC m=+588.773985947"
Jul 31 00:15:49.470352 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:49.470313    2582 generic.go:356] "Generic (PLEG): container finished" podID="3215a728-10ce-46ee-bd0a-6c0cd100a38a" containerID="797459b0d82db89de1aad4a87645c564f54514fcf6053861ec4a04afa49cf55d" exitCode=0
Jul 31 00:15:49.470804 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:49.470407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m" event={"ID":"3215a728-10ce-46ee-bd0a-6c0cd100a38a","Type":"ContainerDied","Data":"797459b0d82db89de1aad4a87645c564f54514fcf6053861ec4a04afa49cf55d"}
Jul 31 00:15:50.477349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:50.477306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m" event={"ID":"3215a728-10ce-46ee-bd0a-6c0cd100a38a","Type":"ContainerStarted","Data":"8b788e04b62e6ae23fae5110264b81764abff6e10da6b42e2799e10bb21f776c"}
Jul 31 00:15:50.477718 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:50.477401    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:15:50.501091 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:50.501026    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m" podStartSLOduration=2.417770329 podStartE2EDuration="7.501008803s" totalImagesPullingTime="3.925923564s" totalInitContainerRuntime="1.15731491s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:15:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:15:50.498580483 +0000 UTC m=+590.775823483" watchObservedRunningTime="2026-07-31 00:15:50.501008803 +0000 UTC m=+590.778251791"
Jul 31 00:15:59.473053 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:15:59.473021    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dbc4bb7b6-4rrbw"
Jul 31 00:16:00.195914 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:00.195875    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:16:00.196088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:00.195885    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:16:00.203440 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:00.203412    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:16:00.203440 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:00.203434    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:16:01.484435 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:01.484401    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bff98467-k7k5m"
Jul 31 00:16:11.390756 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.390711    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"]
Jul 31 00:16:11.394784 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.394758    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.397413 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.397389    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5wdn5\""
Jul 31 00:16:11.397413 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.397403    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 00:16:11.407435 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.407407    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"]
Jul 31 00:16:11.492711 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.492677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.492923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.492729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.492923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.492813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.492923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.492840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.492923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.492867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg9r9\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-kube-api-access-qg9r9\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.493084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.492975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.493084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.493003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.493084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.493030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c45f66b5-6eab-44cf-bb94-128e46e2647f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.493194 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.493091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.594504 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.594732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.594732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594564    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.594732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9r9\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-kube-api-access-qg9r9\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.594732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.594732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.594979 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c45f66b5-6eab-44cf-bb94-128e46e2647f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.595030 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.594994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.595030 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.595020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.595115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.595002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.595115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.595065    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.595115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.595073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.595377 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.595353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.595594 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.595571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c45f66b5-6eab-44cf-bb94-128e46e2647f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.597324 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.597305    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.597451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.597433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.602447 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.602418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.602586 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.602566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9r9\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-kube-api-access-qg9r9\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.707212 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.707109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:11.883355 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.883320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"]
Jul 31 00:16:11.885514 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:16:11.885476    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45f66b5_6eab_44cf_bb94_128e46e2647f.slice/crio-38b4ac2558a4a539f573c4d7e619753aa160928f1007488bd723df62d864838c WatchSource:0}: Error finding container 38b4ac2558a4a539f573c4d7e619753aa160928f1007488bd723df62d864838c: Status 404 returned error can't find the container with id 38b4ac2558a4a539f573c4d7e619753aa160928f1007488bd723df62d864838c
Jul 31 00:16:11.888112 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:11.888089    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:16:12.582917 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:12.582883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" event={"ID":"c45f66b5-6eab-44cf-bb94-128e46e2647f","Type":"ContainerStarted","Data":"38b4ac2558a4a539f573c4d7e619753aa160928f1007488bd723df62d864838c"}
Jul 31 00:16:13.327434 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.327389    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"]
Jul 31 00:16:13.334524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.334495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.337736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.337709    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 31 00:16:13.337736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.337728    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 31 00:16:13.337961 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.337714    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 31 00:16:13.337961 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.337809    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g5nsg\""
Jul 31 00:16:13.345858 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.345825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"]
Jul 31 00:16:13.411203 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.411164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.411380 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.411211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5smfs\" (UniqueName: \"kubernetes.io/projected/4f0c4023-7c5b-4f7e-99dc-403de79acdce-kube-api-access-5smfs\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.411380 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.411234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.411380 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.411341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.411486 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.411398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.411486 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.411427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.411590 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.411530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f0c4023-7c5b-4f7e-99dc-403de79acdce-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.512344 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.512252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.512344 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.512299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.512601 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.512379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f0c4023-7c5b-4f7e-99dc-403de79acdce-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.512601 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.512427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.512601 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.512466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5smfs\" (UniqueName: \"kubernetes.io/projected/4f0c4023-7c5b-4f7e-99dc-403de79acdce-kube-api-access-5smfs\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.512601 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.512492    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.512601 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.512538    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.513548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.513522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.515401 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.515377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f0c4023-7c5b-4f7e-99dc-403de79acdce-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.515518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.515451    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.515605 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.515582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.515685 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.515643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4f0c4023-7c5b-4f7e-99dc-403de79acdce-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.528015 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.527962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f0c4023-7c5b-4f7e-99dc-403de79acdce-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.528458 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.528307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5smfs\" (UniqueName: \"kubernetes.io/projected/4f0c4023-7c5b-4f7e-99dc-403de79acdce-kube-api-access-5smfs\") pod \"istiod-openshift-gateway-5677ccb49b-szwqj\" (UID: \"4f0c4023-7c5b-4f7e-99dc-403de79acdce\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.650051 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.649958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:13.811454 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:13.811423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"]
Jul 31 00:16:13.813223 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:16:13.813197    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0c4023_7c5b_4f7e_99dc_403de79acdce.slice/crio-2fd4095d8f90483d477eed7e48c161a7794906317486a769b767a117bff96680 WatchSource:0}: Error finding container 2fd4095d8f90483d477eed7e48c161a7794906317486a769b767a117bff96680: Status 404 returned error can't find the container with id 2fd4095d8f90483d477eed7e48c161a7794906317486a769b767a117bff96680
Jul 31 00:16:14.598758 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:14.598712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj" event={"ID":"4f0c4023-7c5b-4f7e-99dc-403de79acdce","Type":"ContainerStarted","Data":"2fd4095d8f90483d477eed7e48c161a7794906317486a769b767a117bff96680"}
Jul 31 00:16:15.532757 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:15.532718    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:16:15.533048 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:15.532792    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:16:15.533048 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:15.532825    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:16:16.618815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:16.618763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" event={"ID":"c45f66b5-6eab-44cf-bb94-128e46e2647f","Type":"ContainerStarted","Data":"844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25"}
Jul 31 00:16:16.658333 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:16.658270    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" podStartSLOduration=2.014056463 podStartE2EDuration="5.658251555s" totalImagesPullingTime="3.644195092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:16:16.65476603 +0000 UTC m=+616.932009027" watchObservedRunningTime="2026-07-31 00:16:16.658251555 +0000 UTC m=+616.935494543"
Jul 31 00:16:16.708200 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:16.708161    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:16.709844 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:16.709807    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 31 00:16:16.709987 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:16.709873    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" podUID="c45f66b5-6eab-44cf-bb94-128e46e2647f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 31 00:16:17.206849 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.206803    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"]
Jul 31 00:16:17.359656 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.359596    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:16:17.359802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.359700    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:16:17.625811 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.625767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj" event={"ID":"4f0c4023-7c5b-4f7e-99dc-403de79acdce","Type":"ContainerStarted","Data":"f7e0786ebb3421f7a511c0c94a9022a6f24dbe630c5e466d6e0900b3d12c298f"}
Jul 31 00:16:17.626288 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.625864    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:17.645088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.645023    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj" podStartSLOduration=1.101135906 podStartE2EDuration="4.645004378s" totalImagesPullingTime="3.543868472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:16:17.643687031 +0000 UTC m=+617.920930023" watchObservedRunningTime="2026-07-31 00:16:17.645004378 +0000 UTC m=+617.922247368"
Jul 31 00:16:17.708378 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.708333    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 31 00:16:17.708588 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:17.708404    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" podUID="c45f66b5-6eab-44cf-bb94-128e46e2647f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 31 00:16:18.630651 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:18.630580    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" podUID="c45f66b5-6eab-44cf-bb94-128e46e2647f" containerName="istio-proxy" containerID="cri-o://844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25" gracePeriod=30
Jul 31 00:16:18.632435 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:18.632378    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-szwqj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 00:16:18.632560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:18.632434    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj" podUID="4f0c4023-7c5b-4f7e-99dc-403de79acdce" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 00:16:21.631746 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:21.631712    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-szwqj"
Jul 31 00:16:23.879526 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:23.879500    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:24.012544 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012505    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-token\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012731 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012557    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-credential-socket\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012731 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012657    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg9r9\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-kube-api-access-qg9r9\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012731 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-socket\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012731 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c45f66b5-6eab-44cf-bb94-128e46e2647f-istiod-ca-cert\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012751    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-podinfo\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012794    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-data\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012835    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-certs\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.012923 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012873    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-envoy\") pod \"c45f66b5-6eab-44cf-bb94-128e46e2647f\" (UID: \"c45f66b5-6eab-44cf-bb94-128e46e2647f\") "
Jul 31 00:16:24.013057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.012968    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:16:24.013242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.013216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:16:24.013313 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.013228    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.013313 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.013295    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c45f66b5-6eab-44cf-bb94-128e46e2647f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:16:24.013470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.013425    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:16:24.013470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.013466    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:16:24.015088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.015060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:16:24.015196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.015107    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:16:24.015196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.015120    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 00:16:24.015196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.015124    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-kube-api-access-qg9r9" (OuterVolumeSpecName: "kube-api-access-qg9r9") pod "c45f66b5-6eab-44cf-bb94-128e46e2647f" (UID: "c45f66b5-6eab-44cf-bb94-128e46e2647f"). InnerVolumeSpecName "kube-api-access-qg9r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:16:24.114061 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114022    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg9r9\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-kube-api-access-qg9r9\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.114061 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114052    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.114061 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114062    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c45f66b5-6eab-44cf-bb94-128e46e2647f-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.114061 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114070    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.114061 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114077    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.114386 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114085    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.114386 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114092    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.114386 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.114099    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c45f66b5-6eab-44cf-bb94-128e46e2647f-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:16:24.662144 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.662108    2582 generic.go:356] "Generic (PLEG): container finished" podID="c45f66b5-6eab-44cf-bb94-128e46e2647f" containerID="844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25" exitCode=0
Jul 31 00:16:24.662325 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.662165    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"
Jul 31 00:16:24.662325 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.662200    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" event={"ID":"c45f66b5-6eab-44cf-bb94-128e46e2647f","Type":"ContainerDied","Data":"844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25"}
Jul 31 00:16:24.662325 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.662258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx" event={"ID":"c45f66b5-6eab-44cf-bb94-128e46e2647f","Type":"ContainerDied","Data":"38b4ac2558a4a539f573c4d7e619753aa160928f1007488bd723df62d864838c"}
Jul 31 00:16:24.662325 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.662274    2582 scope.go:117] "RemoveContainer" containerID="844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25"
Jul 31 00:16:24.671421 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.671399    2582 scope.go:117] "RemoveContainer" containerID="844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25"
Jul 31 00:16:24.671772 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:16:24.671746    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25\": container with ID starting with 844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25 not found: ID does not exist" containerID="844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25"
Jul 31 00:16:24.671863 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.671778    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25"} err="failed to get container status \"844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25\": rpc error: code = NotFound desc = could not find container \"844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25\": container with ID starting with 844828e2c6678aeef4144f39d82206494bb20521d9bdcca13da2f39b52fb1f25 not found: ID does not exist"
Jul 31 00:16:24.682678 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.682642    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"]
Jul 31 00:16:24.688610 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:24.688578    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdj9nx"]
Jul 31 00:16:26.252323 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:16:26.252286    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45f66b5-6eab-44cf-bb94-128e46e2647f" path="/var/lib/kubelet/pods/c45f66b5-6eab-44cf-bb94-128e46e2647f/volumes"
Jul 31 00:17:07.763089 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.763052    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"]
Jul 31 00:17:07.763696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.763542    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45f66b5-6eab-44cf-bb94-128e46e2647f" containerName="istio-proxy"
Jul 31 00:17:07.763696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.763563    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45f66b5-6eab-44cf-bb94-128e46e2647f" containerName="istio-proxy"
Jul 31 00:17:07.763696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.763693    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45f66b5-6eab-44cf-bb94-128e46e2647f" containerName="istio-proxy"
Jul 31 00:17:07.766209 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.766189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.768993 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.768968    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 00:17:07.769100 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.769050    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 00:17:07.770183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.770163    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8sfk5\""
Jul 31 00:17:07.774029 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.774003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"]
Jul 31 00:17:07.862345 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.862309    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"]
Jul 31 00:17:07.865141 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.865107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.865418 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.865401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.865531 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.865508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:07.865691 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.865672    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2snwq\" (UniqueName: \"kubernetes.io/projected/7947a670-ef6c-418b-8269-bf3924ae4365-kube-api-access-2snwq\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.881034 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.876231    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"]
Jul 31 00:17:07.961804 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.961768    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"]
Jul 31 00:17:07.964037 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.964021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:07.973298 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.973269    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"]
Jul 31 00:17:07.981448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.981415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2snwq\" (UniqueName: \"kubernetes.io/projected/7947a670-ef6c-418b-8269-bf3924ae4365-kube-api-access-2snwq\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.981603 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.981488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:07.981603 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.981517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.981603 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.981557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:07.981603 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.981590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gffsf\" (UniqueName: \"kubernetes.io/projected/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-kube-api-access-gffsf\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:07.981933 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.981669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.982047 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.982026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.982103 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.982049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:07.989101 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:07.989075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2snwq\" (UniqueName: \"kubernetes.io/projected/7947a670-ef6c-418b-8269-bf3924ae4365-kube-api-access-2snwq\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:08.063252 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.063171    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"]
Jul 31 00:17:08.065717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.065701    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.074967 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.074930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"]
Jul 31 00:17:08.076324 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.076299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:08.082505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.082476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.082640 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.082559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:08.082640 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.082594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.082747 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.082652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:08.082747 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.082680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrct\" (UniqueName: \"kubernetes.io/projected/be382a88-aec7-458f-afa4-47bb419d7632-kube-api-access-zrrct\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.082747 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.082715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gffsf\" (UniqueName: \"kubernetes.io/projected/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-kube-api-access-gffsf\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:08.082926 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.082905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:08.083023 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.083000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:08.090971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.090937    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gffsf\" (UniqueName: \"kubernetes.io/projected/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-kube-api-access-gffsf\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:08.183563 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.183526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.183765 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.183575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hkz4\" (UniqueName: \"kubernetes.io/projected/d41b167b-f288-4365-afbb-a5985fc64c85-kube-api-access-5hkz4\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.183765 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.183645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.183765 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.183691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.183765 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.183720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.183765 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.183756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrct\" (UniqueName: \"kubernetes.io/projected/be382a88-aec7-458f-afa4-47bb419d7632-kube-api-access-zrrct\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.184086 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.183986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.184928 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.184901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.185336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.185319    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:08.193770 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.193745    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrct\" (UniqueName: \"kubernetes.io/projected/be382a88-aec7-458f-afa4-47bb419d7632-kube-api-access-zrrct\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.210705 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.210673    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"]
Jul 31 00:17:08.212786 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:17:08.212761    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7947a670_ef6c_418b_8269_bf3924ae4365.slice/crio-e2d0cc34c0b6200169b1e02f03968bc8f2dec292ccf8c9c8e13842675c517f3f WatchSource:0}: Error finding container e2d0cc34c0b6200169b1e02f03968bc8f2dec292ccf8c9c8e13842675c517f3f: Status 404 returned error can't find the container with id e2d0cc34c0b6200169b1e02f03968bc8f2dec292ccf8c9c8e13842675c517f3f
Jul 31 00:17:08.274895 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.274854    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:08.287661 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.286026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hkz4\" (UniqueName: \"kubernetes.io/projected/d41b167b-f288-4365-afbb-a5985fc64c85-kube-api-access-5hkz4\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.287661 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.286110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.287661 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.286164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.287661 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.286829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.287661 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.287126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.296823 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.296793    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hkz4\" (UniqueName: \"kubernetes.io/projected/d41b167b-f288-4365-afbb-a5985fc64c85-kube-api-access-5hkz4\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.331196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.331168    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"]
Jul 31 00:17:08.366666 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:17:08.366615    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61cdbf1_6d12_42fc_b211_9d8da399c2d3.slice/crio-97ed97f9291aa256ec1eabaefbb8aa9bed648e26c977b63b7f469bc6c743ec89 WatchSource:0}: Error finding container 97ed97f9291aa256ec1eabaefbb8aa9bed648e26c977b63b7f469bc6c743ec89: Status 404 returned error can't find the container with id 97ed97f9291aa256ec1eabaefbb8aa9bed648e26c977b63b7f469bc6c743ec89
Jul 31 00:17:08.376872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.376844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:08.427913 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.427884    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"]
Jul 31 00:17:08.431085 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:17:08.431057    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe382a88_aec7_458f_afa4_47bb419d7632.slice/crio-57be74020e68e6b9c8b02a936c307ca7ce8b6891e42820c39d5ea7dfe5e08239 WatchSource:0}: Error finding container 57be74020e68e6b9c8b02a936c307ca7ce8b6891e42820c39d5ea7dfe5e08239: Status 404 returned error can't find the container with id 57be74020e68e6b9c8b02a936c307ca7ce8b6891e42820c39d5ea7dfe5e08239
Jul 31 00:17:08.529028 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.528999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"]
Jul 31 00:17:08.532519 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:17:08.532483    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41b167b_f288_4365_afbb_a5985fc64c85.slice/crio-a7258b6e030bfe7171183244561c93866089a931e1f79986efb3bf0c939204fd WatchSource:0}: Error finding container a7258b6e030bfe7171183244561c93866089a931e1f79986efb3bf0c939204fd: Status 404 returned error can't find the container with id a7258b6e030bfe7171183244561c93866089a931e1f79986efb3bf0c939204fd
Jul 31 00:17:08.894854 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.894768    2582 generic.go:356] "Generic (PLEG): container finished" podID="d41b167b-f288-4365-afbb-a5985fc64c85" containerID="01e55478cb5face2900cedad8c00bcc4c3cdb75ecd5cde0e23fce16b404782b7" exitCode=0
Jul 31 00:17:08.895299 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.894854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6" event={"ID":"d41b167b-f288-4365-afbb-a5985fc64c85","Type":"ContainerDied","Data":"01e55478cb5face2900cedad8c00bcc4c3cdb75ecd5cde0e23fce16b404782b7"}
Jul 31 00:17:08.895299 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.894911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6" event={"ID":"d41b167b-f288-4365-afbb-a5985fc64c85","Type":"ContainerStarted","Data":"a7258b6e030bfe7171183244561c93866089a931e1f79986efb3bf0c939204fd"}
Jul 31 00:17:08.896501 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.896478    2582 generic.go:356] "Generic (PLEG): container finished" podID="be382a88-aec7-458f-afa4-47bb419d7632" containerID="60f9c53ba7b950834a918b24bbcdefcbe22d22a9aad38f1e169640aa81024d44" exitCode=0
Jul 31 00:17:08.896594 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.896570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw" event={"ID":"be382a88-aec7-458f-afa4-47bb419d7632","Type":"ContainerDied","Data":"60f9c53ba7b950834a918b24bbcdefcbe22d22a9aad38f1e169640aa81024d44"}
Jul 31 00:17:08.896677 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.896618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw" event={"ID":"be382a88-aec7-458f-afa4-47bb419d7632","Type":"ContainerStarted","Data":"57be74020e68e6b9c8b02a936c307ca7ce8b6891e42820c39d5ea7dfe5e08239"}
Jul 31 00:17:08.898236 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.898212    2582 generic.go:356] "Generic (PLEG): container finished" podID="7947a670-ef6c-418b-8269-bf3924ae4365" containerID="10c498f40fa95540eccb54467fb3a9a5d2013aa90394272ee183f54e2c31a774" exitCode=0
Jul 31 00:17:08.898341 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.898284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp" event={"ID":"7947a670-ef6c-418b-8269-bf3924ae4365","Type":"ContainerDied","Data":"10c498f40fa95540eccb54467fb3a9a5d2013aa90394272ee183f54e2c31a774"}
Jul 31 00:17:08.899181 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.898754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp" event={"ID":"7947a670-ef6c-418b-8269-bf3924ae4365","Type":"ContainerStarted","Data":"e2d0cc34c0b6200169b1e02f03968bc8f2dec292ccf8c9c8e13842675c517f3f"}
Jul 31 00:17:08.902771 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.902743    2582 generic.go:356] "Generic (PLEG): container finished" podID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerID="f795729378d2352e2479bc4b5cf6644d80e37a0f2223a437f4ca4ed85bf0bdc3" exitCode=0
Jul 31 00:17:08.903610 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.903583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6" event={"ID":"f61cdbf1-6d12-42fc-b211-9d8da399c2d3","Type":"ContainerDied","Data":"f795729378d2352e2479bc4b5cf6644d80e37a0f2223a437f4ca4ed85bf0bdc3"}
Jul 31 00:17:08.903835 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:08.903717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6" event={"ID":"f61cdbf1-6d12-42fc-b211-9d8da399c2d3","Type":"ContainerStarted","Data":"97ed97f9291aa256ec1eabaefbb8aa9bed648e26c977b63b7f469bc6c743ec89"}
Jul 31 00:17:10.915127 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:10.915093    2582 generic.go:356] "Generic (PLEG): container finished" podID="be382a88-aec7-458f-afa4-47bb419d7632" containerID="085d1dabf1f562e66496e42f9ad8bc78440a8c61b79a218b4b7ef6411e4c083d" exitCode=0
Jul 31 00:17:10.915526 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:10.915175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw" event={"ID":"be382a88-aec7-458f-afa4-47bb419d7632","Type":"ContainerDied","Data":"085d1dabf1f562e66496e42f9ad8bc78440a8c61b79a218b4b7ef6411e4c083d"}
Jul 31 00:17:10.917108 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:10.917081    2582 generic.go:356] "Generic (PLEG): container finished" podID="7947a670-ef6c-418b-8269-bf3924ae4365" containerID="8d7e3912076c717f08dea5e36ed1f4db512fa6d2176bbeaf3ea01fc9e241db63" exitCode=0
Jul 31 00:17:10.917203 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:10.917158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp" event={"ID":"7947a670-ef6c-418b-8269-bf3924ae4365","Type":"ContainerDied","Data":"8d7e3912076c717f08dea5e36ed1f4db512fa6d2176bbeaf3ea01fc9e241db63"}
Jul 31 00:17:10.919136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:10.919117    2582 generic.go:356] "Generic (PLEG): container finished" podID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerID="165ba2de8e288ff5b25e9dbad9900dba26f3e6df46e2a611296fa39718cb47cb" exitCode=0
Jul 31 00:17:10.919218 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:10.919155    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6" event={"ID":"f61cdbf1-6d12-42fc-b211-9d8da399c2d3","Type":"ContainerDied","Data":"165ba2de8e288ff5b25e9dbad9900dba26f3e6df46e2a611296fa39718cb47cb"}
Jul 31 00:17:11.926803 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.926765    2582 generic.go:356] "Generic (PLEG): container finished" podID="d41b167b-f288-4365-afbb-a5985fc64c85" containerID="a9832759675f0f16e82401f8e7456b86978f92809af5b2c1ebdfd7c14e748e59" exitCode=0
Jul 31 00:17:11.927248 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.926843    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6" event={"ID":"d41b167b-f288-4365-afbb-a5985fc64c85","Type":"ContainerDied","Data":"a9832759675f0f16e82401f8e7456b86978f92809af5b2c1ebdfd7c14e748e59"}
Jul 31 00:17:11.929093 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.929062    2582 generic.go:356] "Generic (PLEG): container finished" podID="be382a88-aec7-458f-afa4-47bb419d7632" containerID="aeeae39ee9abdf63ebc2cd2220ba597ecd3566cf66490eec9b7b3592c4c6f5cc" exitCode=0
Jul 31 00:17:11.929169 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.929124    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw" event={"ID":"be382a88-aec7-458f-afa4-47bb419d7632","Type":"ContainerDied","Data":"aeeae39ee9abdf63ebc2cd2220ba597ecd3566cf66490eec9b7b3592c4c6f5cc"}
Jul 31 00:17:11.931344 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.931296    2582 generic.go:356] "Generic (PLEG): container finished" podID="7947a670-ef6c-418b-8269-bf3924ae4365" containerID="2fc006f9e3e596b8cfa4fec77a8b9006f02873651fa65fe2791bb0b5148854f9" exitCode=0
Jul 31 00:17:11.931449 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.931380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp" event={"ID":"7947a670-ef6c-418b-8269-bf3924ae4365","Type":"ContainerDied","Data":"2fc006f9e3e596b8cfa4fec77a8b9006f02873651fa65fe2791bb0b5148854f9"}
Jul 31 00:17:11.933512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.933491    2582 generic.go:356] "Generic (PLEG): container finished" podID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerID="2d7f7e1497db2d60fe0a1750762d7fa01863427632d33675f471d72f04f5c408" exitCode=0
Jul 31 00:17:11.933594 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:11.933548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6" event={"ID":"f61cdbf1-6d12-42fc-b211-9d8da399c2d3","Type":"ContainerDied","Data":"2d7f7e1497db2d60fe0a1750762d7fa01863427632d33675f471d72f04f5c408"}
Jul 31 00:17:12.940894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:12.940859    2582 generic.go:356] "Generic (PLEG): container finished" podID="d41b167b-f288-4365-afbb-a5985fc64c85" containerID="8fabc2ba5c8bfd4ef4037377c97cfa1244e123dc6c2f84f7fee62bfc1f3356eb" exitCode=0
Jul 31 00:17:12.941370 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:12.940955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6" event={"ID":"d41b167b-f288-4365-afbb-a5985fc64c85","Type":"ContainerDied","Data":"8fabc2ba5c8bfd4ef4037377c97cfa1244e123dc6c2f84f7fee62bfc1f3356eb"}
Jul 31 00:17:13.083035 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.083000    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:13.124395 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.124368    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:13.128462 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.128436    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-bundle\") pod \"be382a88-aec7-458f-afa4-47bb419d7632\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") "
Jul 31 00:17:13.128595 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.128474    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-util\") pod \"be382a88-aec7-458f-afa4-47bb419d7632\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") "
Jul 31 00:17:13.128595 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.128499    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrrct\" (UniqueName: \"kubernetes.io/projected/be382a88-aec7-458f-afa4-47bb419d7632-kube-api-access-zrrct\") pod \"be382a88-aec7-458f-afa4-47bb419d7632\" (UID: \"be382a88-aec7-458f-afa4-47bb419d7632\") "
Jul 31 00:17:13.129232 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.129199    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-bundle" (OuterVolumeSpecName: "bundle") pod "be382a88-aec7-458f-afa4-47bb419d7632" (UID: "be382a88-aec7-458f-afa4-47bb419d7632"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:13.132635 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.132584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be382a88-aec7-458f-afa4-47bb419d7632-kube-api-access-zrrct" (OuterVolumeSpecName: "kube-api-access-zrrct") pod "be382a88-aec7-458f-afa4-47bb419d7632" (UID: "be382a88-aec7-458f-afa4-47bb419d7632"). InnerVolumeSpecName "kube-api-access-zrrct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:17:13.135478 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.135453    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-util" (OuterVolumeSpecName: "util") pod "be382a88-aec7-458f-afa4-47bb419d7632" (UID: "be382a88-aec7-458f-afa4-47bb419d7632"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:13.152346 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.152322    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:13.229185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229097    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-util\") pod \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") "
Jul 31 00:17:13.229185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229140    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gffsf\" (UniqueName: \"kubernetes.io/projected/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-kube-api-access-gffsf\") pod \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") "
Jul 31 00:17:13.229185 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229188    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-bundle\") pod \"7947a670-ef6c-418b-8269-bf3924ae4365\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") "
Jul 31 00:17:13.229521 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229220    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-bundle\") pod \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\" (UID: \"f61cdbf1-6d12-42fc-b211-9d8da399c2d3\") "
Jul 31 00:17:13.229521 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229247    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-util\") pod \"7947a670-ef6c-418b-8269-bf3924ae4365\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") "
Jul 31 00:17:13.229521 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229275    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2snwq\" (UniqueName: \"kubernetes.io/projected/7947a670-ef6c-418b-8269-bf3924ae4365-kube-api-access-2snwq\") pod \"7947a670-ef6c-418b-8269-bf3924ae4365\" (UID: \"7947a670-ef6c-418b-8269-bf3924ae4365\") "
Jul 31 00:17:13.229703 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229520    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.229703 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229540    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be382a88-aec7-458f-afa4-47bb419d7632-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.229703 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229553    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrrct\" (UniqueName: \"kubernetes.io/projected/be382a88-aec7-458f-afa4-47bb419d7632-kube-api-access-zrrct\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.229990 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229895    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-bundle" (OuterVolumeSpecName: "bundle") pod "7947a670-ef6c-418b-8269-bf3924ae4365" (UID: "7947a670-ef6c-418b-8269-bf3924ae4365"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:13.229990 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.229934    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-bundle" (OuterVolumeSpecName: "bundle") pod "f61cdbf1-6d12-42fc-b211-9d8da399c2d3" (UID: "f61cdbf1-6d12-42fc-b211-9d8da399c2d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:13.232190 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.232167    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-kube-api-access-gffsf" (OuterVolumeSpecName: "kube-api-access-gffsf") pod "f61cdbf1-6d12-42fc-b211-9d8da399c2d3" (UID: "f61cdbf1-6d12-42fc-b211-9d8da399c2d3"). InnerVolumeSpecName "kube-api-access-gffsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:17:13.232190 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.232178    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7947a670-ef6c-418b-8269-bf3924ae4365-kube-api-access-2snwq" (OuterVolumeSpecName: "kube-api-access-2snwq") pod "7947a670-ef6c-418b-8269-bf3924ae4365" (UID: "7947a670-ef6c-418b-8269-bf3924ae4365"). InnerVolumeSpecName "kube-api-access-2snwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:17:13.235521 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.235497    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-util" (OuterVolumeSpecName: "util") pod "7947a670-ef6c-418b-8269-bf3924ae4365" (UID: "7947a670-ef6c-418b-8269-bf3924ae4365"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:13.236042 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.236018    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-util" (OuterVolumeSpecName: "util") pod "f61cdbf1-6d12-42fc-b211-9d8da399c2d3" (UID: "f61cdbf1-6d12-42fc-b211-9d8da399c2d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:13.330558 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.330526    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.330558 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.330559    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2snwq\" (UniqueName: \"kubernetes.io/projected/7947a670-ef6c-418b-8269-bf3924ae4365-kube-api-access-2snwq\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.330787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.330570    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.330787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.330579    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gffsf\" (UniqueName: \"kubernetes.io/projected/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-kube-api-access-gffsf\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.330787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.330587    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7947a670-ef6c-418b-8269-bf3924ae4365-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.330787 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.330595    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f61cdbf1-6d12-42fc-b211-9d8da399c2d3-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:13.947932 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.947890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw" event={"ID":"be382a88-aec7-458f-afa4-47bb419d7632","Type":"ContainerDied","Data":"57be74020e68e6b9c8b02a936c307ca7ce8b6891e42820c39d5ea7dfe5e08239"}
Jul 31 00:17:13.948354 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.947955    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57be74020e68e6b9c8b02a936c307ca7ce8b6891e42820c39d5ea7dfe5e08239"
Jul 31 00:17:13.948354 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.947906    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gdbdw"
Jul 31 00:17:13.949845 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.949817    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp" event={"ID":"7947a670-ef6c-418b-8269-bf3924ae4365","Type":"ContainerDied","Data":"e2d0cc34c0b6200169b1e02f03968bc8f2dec292ccf8c9c8e13842675c517f3f"}
Jul 31 00:17:13.949978 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.949845    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbtq2hp"
Jul 31 00:17:13.949978 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.949864    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2d0cc34c0b6200169b1e02f03968bc8f2dec292ccf8c9c8e13842675c517f3f"
Jul 31 00:17:13.951684 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.951666    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6"
Jul 31 00:17:13.951794 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.951670    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0dwgd6" event={"ID":"f61cdbf1-6d12-42fc-b211-9d8da399c2d3","Type":"ContainerDied","Data":"97ed97f9291aa256ec1eabaefbb8aa9bed648e26c977b63b7f469bc6c743ec89"}
Jul 31 00:17:13.951794 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:13.951730    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97ed97f9291aa256ec1eabaefbb8aa9bed648e26c977b63b7f469bc6c743ec89"
Jul 31 00:17:14.087118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.087093    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:17:14.137021 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.136994    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-util\") pod \"d41b167b-f288-4365-afbb-a5985fc64c85\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") "
Jul 31 00:17:14.137212 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.137054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hkz4\" (UniqueName: \"kubernetes.io/projected/d41b167b-f288-4365-afbb-a5985fc64c85-kube-api-access-5hkz4\") pod \"d41b167b-f288-4365-afbb-a5985fc64c85\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") "
Jul 31 00:17:14.137212 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.137112    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-bundle\") pod \"d41b167b-f288-4365-afbb-a5985fc64c85\" (UID: \"d41b167b-f288-4365-afbb-a5985fc64c85\") "
Jul 31 00:17:14.137639 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.137592    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-bundle" (OuterVolumeSpecName: "bundle") pod "d41b167b-f288-4365-afbb-a5985fc64c85" (UID: "d41b167b-f288-4365-afbb-a5985fc64c85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:14.139135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.139106    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d41b167b-f288-4365-afbb-a5985fc64c85-kube-api-access-5hkz4" (OuterVolumeSpecName: "kube-api-access-5hkz4") pod "d41b167b-f288-4365-afbb-a5985fc64c85" (UID: "d41b167b-f288-4365-afbb-a5985fc64c85"). InnerVolumeSpecName "kube-api-access-5hkz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:17:14.142972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.142943    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-util" (OuterVolumeSpecName: "util") pod "d41b167b-f288-4365-afbb-a5985fc64c85" (UID: "d41b167b-f288-4365-afbb-a5985fc64c85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:17:14.238459 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.238376    2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-util\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:14.238459 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.238406    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hkz4\" (UniqueName: \"kubernetes.io/projected/d41b167b-f288-4365-afbb-a5985fc64c85-kube-api-access-5hkz4\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:14.238459 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.238418    2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d41b167b-f288-4365-afbb-a5985fc64c85-bundle\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:17:14.958573 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.958539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6" event={"ID":"d41b167b-f288-4365-afbb-a5985fc64c85","Type":"ContainerDied","Data":"a7258b6e030bfe7171183244561c93866089a931e1f79986efb3bf0c939204fd"}
Jul 31 00:17:14.958960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.958591    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7258b6e030bfe7171183244561c93866089a931e1f79986efb3bf0c939204fd"
Jul 31 00:17:14.958960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:17:14.958548    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9b7t6"
Jul 31 00:18:28.845208 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845173    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"]
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845510    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerName="extract"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845521    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerName="extract"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845529    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41b167b-f288-4365-afbb-a5985fc64c85" containerName="util"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845536    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41b167b-f288-4365-afbb-a5985fc64c85" containerName="util"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845546    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41b167b-f288-4365-afbb-a5985fc64c85" containerName="extract"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845553    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41b167b-f288-4365-afbb-a5985fc64c85" containerName="extract"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845562    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerName="pull"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845567    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerName="pull"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845574    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7947a670-ef6c-418b-8269-bf3924ae4365" containerName="pull"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845581    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7947a670-ef6c-418b-8269-bf3924ae4365" containerName="pull"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845590    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7947a670-ef6c-418b-8269-bf3924ae4365" containerName="util"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845595    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7947a670-ef6c-418b-8269-bf3924ae4365" containerName="util"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845601    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be382a88-aec7-458f-afa4-47bb419d7632" containerName="pull"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845606    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be382a88-aec7-458f-afa4-47bb419d7632" containerName="pull"
Jul 31 00:18:28.845609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845614    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d41b167b-f288-4365-afbb-a5985fc64c85" containerName="pull"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845619    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d41b167b-f288-4365-afbb-a5985fc64c85" containerName="pull"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845645    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be382a88-aec7-458f-afa4-47bb419d7632" containerName="extract"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845650    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be382a88-aec7-458f-afa4-47bb419d7632" containerName="extract"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845656    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerName="util"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845661    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerName="util"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845666    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7947a670-ef6c-418b-8269-bf3924ae4365" containerName="extract"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845671    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7947a670-ef6c-418b-8269-bf3924ae4365" containerName="extract"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845677    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be382a88-aec7-458f-afa4-47bb419d7632" containerName="util"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845682    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be382a88-aec7-458f-afa4-47bb419d7632" containerName="util"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845737    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61cdbf1-6d12-42fc-b211-9d8da399c2d3" containerName="extract"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845744    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7947a670-ef6c-418b-8269-bf3924ae4365" containerName="extract"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845750    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be382a88-aec7-458f-afa4-47bb419d7632" containerName="extract"
Jul 31 00:18:28.846080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.845756    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d41b167b-f288-4365-afbb-a5985fc64c85" containerName="extract"
Jul 31 00:18:28.848820 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.848802    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.851482 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.851461    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kkg6q\""
Jul 31 00:18:28.858859 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.858839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"]
Jul 31 00:18:28.990947 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.990903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.990947 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.990946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m24n2\" (UniqueName: \"kubernetes.io/projected/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-kube-api-access-m24n2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.991169 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.990968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.991169 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.991057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.991169 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.991093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.991169 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.991111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.991169 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.991149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.991331 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.991177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:28.991331 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:28.991231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092433 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m24n2\" (UniqueName: \"kubernetes.io/projected/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-kube-api-access-m24n2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.092971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.092958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.093190 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.093176    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.093247 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.093197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.093352 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.093331    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.094877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.094854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.095124 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.095105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.100254 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.100196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.100960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.100934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m24n2\" (UniqueName: \"kubernetes.io/projected/e95c08bb-7fa6-48d3-9936-0adf0b001f0a-kube-api-access-m24n2\") pod \"maas-default-gateway-openshift-default-78bb78ff78-rrm47\" (UID: \"e95c08bb-7fa6-48d3-9936-0adf0b001f0a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.160577 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.160539    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:29.299450 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.299424    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"]
Jul 31 00:18:29.301605 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:18:29.301578    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95c08bb_7fa6_48d3_9936_0adf0b001f0a.slice/crio-0111946e27d31d05a1a869cfb4f3da71543cd4dccf1e41740710097d318d7aa2 WatchSource:0}: Error finding container 0111946e27d31d05a1a869cfb4f3da71543cd4dccf1e41740710097d318d7aa2: Status 404 returned error can't find the container with id 0111946e27d31d05a1a869cfb4f3da71543cd4dccf1e41740710097d318d7aa2
Jul 31 00:18:29.303804 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.303767    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:18:29.303873 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.303852    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:18:29.303915 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.303893    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:18:29.349922 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:29.349891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" event={"ID":"e95c08bb-7fa6-48d3-9936-0adf0b001f0a","Type":"ContainerStarted","Data":"0111946e27d31d05a1a869cfb4f3da71543cd4dccf1e41740710097d318d7aa2"}
Jul 31 00:18:30.356948 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:30.356916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" event={"ID":"e95c08bb-7fa6-48d3-9936-0adf0b001f0a","Type":"ContainerStarted","Data":"8fe51ecbbf97f442282385e0f788e9286529068afe17ceb73c2dcf3cb57cc6cd"}
Jul 31 00:18:30.376055 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:30.376000    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" podStartSLOduration=2.3759801019999998 podStartE2EDuration="2.375980102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:18:30.375009528 +0000 UTC m=+750.652252511" watchObservedRunningTime="2026-07-31 00:18:30.375980102 +0000 UTC m=+750.653223093"
Jul 31 00:18:31.161777 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:31.161737    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:31.167042 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:31.167012    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:31.362256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:31.362227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:18:31.363128 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:18:31.363106    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:19:07.580067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.580033    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69c478475b-9dgtr"]
Jul 31 00:19:07.583563 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.583543    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:07.586286 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.586266    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 00:19:07.586506 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.586264    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 00:19:07.586506 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.586351    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bsnn2\""
Jul 31 00:19:07.592156 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.592121    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69c478475b-9dgtr"]
Jul 31 00:19:07.728593 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.728553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:07.728772 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.728597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgtmr\" (UniqueName: \"kubernetes.io/projected/81a50107-787a-4b0b-bb77-830c8bb91756-kube-api-access-pgtmr\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:07.829336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.829295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:07.829515 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.829347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgtmr\" (UniqueName: \"kubernetes.io/projected/81a50107-787a-4b0b-bb77-830c8bb91756-kube-api-access-pgtmr\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:07.829515 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:19:07.829454    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 31 00:19:07.829592 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:19:07.829522    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert podName:81a50107-787a-4b0b-bb77-830c8bb91756 nodeName:}" failed. No retries permitted until 2026-07-31 00:19:08.329505294 +0000 UTC m=+788.606748261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert") pod "maas-controller-69c478475b-9dgtr" (UID: "81a50107-787a-4b0b-bb77-830c8bb91756") : secret "maas-controller-webhook-cert" not found
Jul 31 00:19:07.837819 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:07.837747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgtmr\" (UniqueName: \"kubernetes.io/projected/81a50107-787a-4b0b-bb77-830c8bb91756-kube-api-access-pgtmr\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:08.333620 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:08.333572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:08.333865 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:19:08.333711    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 31 00:19:08.333865 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:19:08.333783    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert podName:81a50107-787a-4b0b-bb77-830c8bb91756 nodeName:}" failed. No retries permitted until 2026-07-31 00:19:09.333764699 +0000 UTC m=+789.611007671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert") pod "maas-controller-69c478475b-9dgtr" (UID: "81a50107-787a-4b0b-bb77-830c8bb91756") : secret "maas-controller-webhook-cert" not found
Jul 31 00:19:09.345327 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:09.345283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:09.347859 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:09.347836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert\") pod \"maas-controller-69c478475b-9dgtr\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") " pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:09.395122 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:09.395081    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:09.529815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:09.529785    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69c478475b-9dgtr"]
Jul 31 00:19:09.532456 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:19:09.532427    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a50107_787a_4b0b_bb77_830c8bb91756.slice/crio-89100c9f05f5c251d2b1f7a1f2af5b99d85b6adb262d5f419adc40c3b35099c6 WatchSource:0}: Error finding container 89100c9f05f5c251d2b1f7a1f2af5b99d85b6adb262d5f419adc40c3b35099c6: Status 404 returned error can't find the container with id 89100c9f05f5c251d2b1f7a1f2af5b99d85b6adb262d5f419adc40c3b35099c6
Jul 31 00:19:09.563209 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:09.563168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c478475b-9dgtr" event={"ID":"81a50107-787a-4b0b-bb77-830c8bb91756","Type":"ContainerStarted","Data":"89100c9f05f5c251d2b1f7a1f2af5b99d85b6adb262d5f419adc40c3b35099c6"}
Jul 31 00:19:12.583722 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:12.583671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c478475b-9dgtr" event={"ID":"81a50107-787a-4b0b-bb77-830c8bb91756","Type":"ContainerStarted","Data":"94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49"}
Jul 31 00:19:12.584113 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:12.583887    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:12.601354 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:12.601300    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69c478475b-9dgtr" podStartSLOduration=3.376064626 podStartE2EDuration="5.601281129s" totalImagesPullingTime="2.225216503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:19:12.598864733 +0000 UTC m=+792.876107721" watchObservedRunningTime="2026-07-31 00:19:12.601281129 +0000 UTC m=+792.878524118"
Jul 31 00:19:22.840522 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:22.840437    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69c478475b-9dgtr"]
Jul 31 00:19:22.841092 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:22.840703    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-69c478475b-9dgtr" podUID="81a50107-787a-4b0b-bb77-830c8bb91756" containerName="manager" containerID="cri-o://94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49" gracePeriod=30
Jul 31 00:19:22.842387 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:22.842364    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:23.091562 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.091498    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:23.180171 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.180132    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert\") pod \"81a50107-787a-4b0b-bb77-830c8bb91756\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") "
Jul 31 00:19:23.180377 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.180218    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgtmr\" (UniqueName: \"kubernetes.io/projected/81a50107-787a-4b0b-bb77-830c8bb91756-kube-api-access-pgtmr\") pod \"81a50107-787a-4b0b-bb77-830c8bb91756\" (UID: \"81a50107-787a-4b0b-bb77-830c8bb91756\") "
Jul 31 00:19:23.182501 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.182473    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "81a50107-787a-4b0b-bb77-830c8bb91756" (UID: "81a50107-787a-4b0b-bb77-830c8bb91756"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:19:23.182599 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.182467    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a50107-787a-4b0b-bb77-830c8bb91756-kube-api-access-pgtmr" (OuterVolumeSpecName: "kube-api-access-pgtmr") pod "81a50107-787a-4b0b-bb77-830c8bb91756" (UID: "81a50107-787a-4b0b-bb77-830c8bb91756"). InnerVolumeSpecName "kube-api-access-pgtmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:19:23.281818 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.281770    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgtmr\" (UniqueName: \"kubernetes.io/projected/81a50107-787a-4b0b-bb77-830c8bb91756-kube-api-access-pgtmr\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:19:23.281818 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.281806    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81a50107-787a-4b0b-bb77-830c8bb91756-webhook-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:19:23.642981 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.642939    2582 generic.go:356] "Generic (PLEG): container finished" podID="81a50107-787a-4b0b-bb77-830c8bb91756" containerID="94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49" exitCode=0
Jul 31 00:19:23.643136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.642993    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c478475b-9dgtr"
Jul 31 00:19:23.643136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.643000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c478475b-9dgtr" event={"ID":"81a50107-787a-4b0b-bb77-830c8bb91756","Type":"ContainerDied","Data":"94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49"}
Jul 31 00:19:23.643136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.643055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c478475b-9dgtr" event={"ID":"81a50107-787a-4b0b-bb77-830c8bb91756","Type":"ContainerDied","Data":"89100c9f05f5c251d2b1f7a1f2af5b99d85b6adb262d5f419adc40c3b35099c6"}
Jul 31 00:19:23.643136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.643088    2582 scope.go:117] "RemoveContainer" containerID="94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49"
Jul 31 00:19:23.652890 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.652864    2582 scope.go:117] "RemoveContainer" containerID="94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49"
Jul 31 00:19:23.653168 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:19:23.653150    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49\": container with ID starting with 94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49 not found: ID does not exist" containerID="94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49"
Jul 31 00:19:23.653218 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.653178    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49"} err="failed to get container status \"94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49\": rpc error: code = NotFound desc = could not find container \"94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49\": container with ID starting with 94c56951d799f34428359ca8ccd976b0c8e013ce68f0b1fc0e499d8a59c38d49 not found: ID does not exist"
Jul 31 00:19:23.668278 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.668230    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69c478475b-9dgtr"]
Jul 31 00:19:23.676385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:23.673563    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69c478475b-9dgtr"]
Jul 31 00:19:24.248495 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:24.248448    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a50107-787a-4b0b-bb77-830c8bb91756" path="/var/lib/kubelet/pods/81a50107-787a-4b0b-bb77-830c8bb91756/volumes"
Jul 31 00:19:44.476898 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.476856    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"]
Jul 31 00:19:44.477534 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.477437    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a50107-787a-4b0b-bb77-830c8bb91756" containerName="manager"
Jul 31 00:19:44.477534 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.477460    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a50107-787a-4b0b-bb77-830c8bb91756" containerName="manager"
Jul 31 00:19:44.477684 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.477593    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a50107-787a-4b0b-bb77-830c8bb91756" containerName="manager"
Jul 31 00:19:44.480682 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.480660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.483638 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.483599    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 31 00:19:44.483779 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.483649    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 31 00:19:44.483779 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.483657    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 00:19:44.490411 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.490383    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"]
Jul 31 00:19:44.562526 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.562478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-maas-api-tls\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.562526 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.562525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w7gk\" (UniqueName: \"kubernetes.io/projected/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-kube-api-access-7w7gk\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.562830 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.562599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-openshift-service-ca\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.663919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.663869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-maas-api-tls\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.663919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.663928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w7gk\" (UniqueName: \"kubernetes.io/projected/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-kube-api-access-7w7gk\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.664214 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.663970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-openshift-service-ca\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.664675 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.664655    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-openshift-service-ca\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.666478 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.666456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-maas-api-tls\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.671910 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.671883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w7gk\" (UniqueName: \"kubernetes.io/projected/ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777-kube-api-access-7w7gk\") pod \"maas-api-8f98fb876-pkvw7\" (UID: \"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777\") " pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.794517 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.794481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:44.941009 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:44.940978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"]
Jul 31 00:19:44.942372 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:19:44.942344    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfaa997_36fc_4ef3_a2c7_19ba7cc8f777.slice/crio-4d57adba259936e0e740c93fc43b6c2d2afb4be3e6db4d137b3953c2e2c45ed8 WatchSource:0}: Error finding container 4d57adba259936e0e740c93fc43b6c2d2afb4be3e6db4d137b3953c2e2c45ed8: Status 404 returned error can't find the container with id 4d57adba259936e0e740c93fc43b6c2d2afb4be3e6db4d137b3953c2e2c45ed8
Jul 31 00:19:45.769498 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:45.769414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7" event={"ID":"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777","Type":"ContainerStarted","Data":"4d57adba259936e0e740c93fc43b6c2d2afb4be3e6db4d137b3953c2e2c45ed8"}
Jul 31 00:19:47.783267 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:47.783228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7" event={"ID":"ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777","Type":"ContainerStarted","Data":"bad0024a5a6fd47e218f366d1efeb6324680439b7d7a20502f62c67c90fe8ea3"}
Jul 31 00:19:47.783709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:47.783345    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:47.800194 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:47.800137    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7" podStartSLOduration=2.055336193 podStartE2EDuration="3.800104842s" totalImagesPullingTime="1.744768649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:19:47.798599483 +0000 UTC m=+828.075842473" watchObservedRunningTime="2026-07-31 00:19:47.800104842 +0000 UTC m=+828.077347831"
Jul 31 00:19:53.794178 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:53.794146    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8f98fb876-pkvw7"
Jul 31 00:19:54.826062 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:54.826029    2582 generic.go:356] "Generic (PLEG): container finished" podID="e95c08bb-7fa6-48d3-9936-0adf0b001f0a" containerID="8fe51ecbbf97f442282385e0f788e9286529068afe17ceb73c2dcf3cb57cc6cd" exitCode=0
Jul 31 00:19:54.826495 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:54.826081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" event={"ID":"e95c08bb-7fa6-48d3-9936-0adf0b001f0a","Type":"ContainerDied","Data":"8fe51ecbbf97f442282385e0f788e9286529068afe17ceb73c2dcf3cb57cc6cd"}
Jul 31 00:19:54.826495 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:54.826456    2582 scope.go:117] "RemoveContainer" containerID="8fe51ecbbf97f442282385e0f788e9286529068afe17ceb73c2dcf3cb57cc6cd"
Jul 31 00:19:54.827545 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:54.827520    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:19:54.827610 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:54.827591    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:19:54.827672 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:54.827648    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:19:55.849615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:55.849573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" event={"ID":"e95c08bb-7fa6-48d3-9936-0adf0b001f0a","Type":"ContainerStarted","Data":"1f0494a348085d4630ef16c7a833346885ce70f9d2672fb5697bd2bcfba1dc2c"}
Jul 31 00:19:56.161532 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:56.161403    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:19:56.161958 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:56.161856    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rrm47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 31 00:19:56.162141 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:56.162119    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" podUID="e95c08bb-7fa6-48d3-9936-0adf0b001f0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 31 00:19:57.161220 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:57.161176    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rrm47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 31 00:19:57.161664 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:57.161243    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" podUID="e95c08bb-7fa6-48d3-9936-0adf0b001f0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 31 00:19:58.161820 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:58.161779    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rrm47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 31 00:19:58.162231 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:58.161857    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" podUID="e95c08bb-7fa6-48d3-9936-0adf0b001f0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 31 00:19:59.161513 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:59.161469    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rrm47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 31 00:19:59.161734 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:19:59.161533    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" podUID="e95c08bb-7fa6-48d3-9936-0adf0b001f0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 31 00:20:00.160955 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:00.160920    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rrm47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 31 00:20:00.161410 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:00.160997    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" podUID="e95c08bb-7fa6-48d3-9936-0adf0b001f0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 31 00:20:01.161706 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:01.161667    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-rrm47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 31 00:20:01.162122 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:01.161742    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47" podUID="e95c08bb-7fa6-48d3-9936-0adf0b001f0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 31 00:20:01.363095 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:01.363057    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:20:02.164786 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:02.164752    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:20:02.165893 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:02.165871    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-rrm47"
Jul 31 00:20:34.985248 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:34.985207    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"]
Jul 31 00:20:34.989215 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:34.989190    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:34.992225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:34.992198    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2gmq\""
Jul 31 00:20:34.993634 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:34.993589    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 31 00:20:34.993763 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:34.993596    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 00:20:34.993763 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:34.993652    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 00:20:34.998430 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:34.998410    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"]
Jul 31 00:20:35.018340 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.018305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.018340 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.018342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.018614 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.018427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.018614 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.018486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-524p2\" (UniqueName: \"kubernetes.io/projected/98e74bc1-29ca-4906-9781-5168e2c96367-kube-api-access-524p2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.018614 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.018554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.018614 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.018584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e74bc1-29ca-4906-9781-5168e2c96367-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119390 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119390 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e74bc1-29ca-4906-9781-5168e2c96367-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-524p2\" (UniqueName: \"kubernetes.io/projected/98e74bc1-29ca-4906-9781-5168e2c96367-kube-api-access-524p2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119944 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.119987 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.120022 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.119991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.121768 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.121739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98e74bc1-29ca-4906-9781-5168e2c96367-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.122017 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.122000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98e74bc1-29ca-4906-9781-5168e2c96367-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.127191 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.127170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-524p2\" (UniqueName: \"kubernetes.io/projected/98e74bc1-29ca-4906-9781-5168e2c96367-kube-api-access-524p2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rgjvk\" (UID: \"98e74bc1-29ca-4906-9781-5168e2c96367\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.302121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.302078    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:35.443058 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:35.443032    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"]
Jul 31 00:20:35.444796 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:20:35.444765    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e74bc1_29ca_4906_9781_5168e2c96367.slice/crio-54748428f5e34b64ce5810d5c966bd43363b183446a84451fb1176d982bb699d WatchSource:0}: Error finding container 54748428f5e34b64ce5810d5c966bd43363b183446a84451fb1176d982bb699d: Status 404 returned error can't find the container with id 54748428f5e34b64ce5810d5c966bd43363b183446a84451fb1176d982bb699d
Jul 31 00:20:36.071424 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:36.071380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk" event={"ID":"98e74bc1-29ca-4906-9781-5168e2c96367","Type":"ContainerStarted","Data":"54748428f5e34b64ce5810d5c966bd43363b183446a84451fb1176d982bb699d"}
Jul 31 00:20:37.078815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:37.078766    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk" event={"ID":"98e74bc1-29ca-4906-9781-5168e2c96367","Type":"ContainerStarted","Data":"57b16f360d1d630639a41fbdae86fa57587c6272cf4eec07f0a7509427e32f26"}
Jul 31 00:20:37.097650 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:37.097585    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk" podStartSLOduration=2.135187103 podStartE2EDuration="3.097566581s" totalImagesPullingTime="962.379478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:20:37.095975792 +0000 UTC m=+877.373218782" watchObservedRunningTime="2026-07-31 00:20:37.097566581 +0000 UTC m=+877.374809570"
Jul 31 00:20:43.977950 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.977911    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"]
Jul 31 00:20:43.981488 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.981469    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:43.984080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.984052    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 31 00:20:43.992286 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.992253    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"]
Jul 31 00:20:43.994069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.994043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:43.994222 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.994077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c52adc3-8056-4166-be34-da464c5588ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:43.994222 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.994107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:43.994222 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.994144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:43.994222 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.994178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:43.994451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:43.994251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66cdt\" (UniqueName: \"kubernetes.io/projected/2c52adc3-8056-4166-be34-da464c5588ef-kube-api-access-66cdt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095283 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095283 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095282    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c52adc3-8056-4166-be34-da464c5588ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095555 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095555 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095555 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095555 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66cdt\" (UniqueName: \"kubernetes.io/projected/2c52adc3-8056-4166-be34-da464c5588ef-kube-api-access-66cdt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095840 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095898 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.095898 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.095882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.097732 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.097702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c52adc3-8056-4166-be34-da464c5588ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.097872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.097851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c52adc3-8056-4166-be34-da464c5588ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.102975 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.102952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66cdt\" (UniqueName: \"kubernetes.io/projected/2c52adc3-8056-4166-be34-da464c5588ef-kube-api-access-66cdt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6\" (UID: \"2c52adc3-8056-4166-be34-da464c5588ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.294321 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.294277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:44.438463 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:44.438421    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"]
Jul 31 00:20:44.441941 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:20:44.441897    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c52adc3_8056_4166_be34_da464c5588ef.slice/crio-f17614235ab5bb373154edefdff16cefb231a0af49d625a51d4b8e8e6f12e142 WatchSource:0}: Error finding container f17614235ab5bb373154edefdff16cefb231a0af49d625a51d4b8e8e6f12e142: Status 404 returned error can't find the container with id f17614235ab5bb373154edefdff16cefb231a0af49d625a51d4b8e8e6f12e142
Jul 31 00:20:45.131141 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:45.131105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6" event={"ID":"2c52adc3-8056-4166-be34-da464c5588ef","Type":"ContainerStarted","Data":"813867eaf1b9be232df1031da25dc91df5bac681b888bf0b1ff0a342d809fe35"}
Jul 31 00:20:45.131553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:45.131162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6" event={"ID":"2c52adc3-8056-4166-be34-da464c5588ef","Type":"ContainerStarted","Data":"f17614235ab5bb373154edefdff16cefb231a0af49d625a51d4b8e8e6f12e142"}
Jul 31 00:20:45.152587 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:45.152523    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6" podStartSLOduration=1.9879226939999999 podStartE2EDuration="2.152506003s" totalImagesPullingTime="164.583309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:20:45.150172693 +0000 UTC m=+885.427415694" watchObservedRunningTime="2026-07-31 00:20:45.152506003 +0000 UTC m=+885.429748992"
Jul 31 00:20:45.302382 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:45.302332    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:45.302579 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:45.302434    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:45.315615 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:45.315580    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:46.156258 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:46.156220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rgjvk"
Jul 31 00:20:54.294736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:54.294608    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:54.294736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:54.294702    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:54.307258 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:54.307229    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:20:55.197084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:20:55.197050    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6"
Jul 31 00:21:00.233018 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:21:00.232983    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:21:00.235209 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:21:00.235180    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:21:00.240577 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:21:00.240551    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:21:00.242802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:21:00.242779    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:26:00.275268 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:26:00.275238    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:26:00.278177 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:26:00.278155    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:26:00.282712 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:26:00.282681    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:26:00.285237 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:26:00.285218    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:30:00.143219 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:00.143188    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk"]
Jul 31 00:30:00.146551 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:00.146534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk"
Jul 31 00:30:00.149518 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:00.149497    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 00:30:00.156443 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:00.156423    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk"
Jul 31 00:30:00.164494 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:00.164463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk"]
Jul 31 00:30:00.296879 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:00.296851    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk"]
Jul 31 00:30:00.298568 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:30:00.298544    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a493bc7_a619_48fc_8fac_eb63924b2835.slice/crio-cd0378824403b6bfbbf316d2d93e62774a018def6d94e4d0d098eae4ed061028 WatchSource:0}: Error finding container cd0378824403b6bfbbf316d2d93e62774a018def6d94e4d0d098eae4ed061028: Status 404 returned error can't find the container with id cd0378824403b6bfbbf316d2d93e62774a018def6d94e4d0d098eae4ed061028
Jul 31 00:30:00.300582 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:00.300564    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:30:01.151563 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:01.151524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk" event={"ID":"1a493bc7-a619-48fc-8fac-eb63924b2835","Type":"ContainerStarted","Data":"cd0378824403b6bfbbf316d2d93e62774a018def6d94e4d0d098eae4ed061028"}
Jul 31 00:30:03.163566 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:03.163495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk" event={"ID":"1a493bc7-a619-48fc-8fac-eb63924b2835","Type":"ContainerStarted","Data":"3442e61433b6a1fd46a4c4f9bd0ab4c3612377db1cf30ba9ca9dd47c091d20a2"}
Jul 31 00:30:03.178224 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:03.178173    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk" podStartSLOduration=0.564044254 podStartE2EDuration="3.178157978s" totalImagesPullingTime="2.614113724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:30:03.176411931 +0000 UTC m=+1443.453654923" watchObservedRunningTime="2026-07-31 00:30:03.178157978 +0000 UTC m=+1443.455400967"
Jul 31 00:30:04.170764 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:04.170726    2582 generic.go:356] "Generic (PLEG): container finished" podID="1a493bc7-a619-48fc-8fac-eb63924b2835" containerID="3442e61433b6a1fd46a4c4f9bd0ab4c3612377db1cf30ba9ca9dd47c091d20a2" exitCode=0
Jul 31 00:30:04.171143 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:04.170816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk" event={"ID":"1a493bc7-a619-48fc-8fac-eb63924b2835","Type":"ContainerDied","Data":"3442e61433b6a1fd46a4c4f9bd0ab4c3612377db1cf30ba9ca9dd47c091d20a2"}
Jul 31 00:30:05.310029 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:05.309999    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk"
Jul 31 00:30:06.183002 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:06.182973    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk"
Jul 31 00:30:06.183180 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:06.183011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757630-rgbqk" event={"ID":"1a493bc7-a619-48fc-8fac-eb63924b2835","Type":"ContainerDied","Data":"cd0378824403b6bfbbf316d2d93e62774a018def6d94e4d0d098eae4ed061028"}
Jul 31 00:30:06.183180 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:30:06.183056    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd0378824403b6bfbbf316d2d93e62774a018def6d94e4d0d098eae4ed061028"
Jul 31 00:31:00.311595 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:31:00.311564    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:31:00.314013 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:31:00.313923    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:31:00.319353 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:31:00.319333    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:31:00.321355 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:31:00.321337    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:36:00.352090 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:36:00.351968    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:36:00.358843 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:36:00.355527    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:36:00.359708 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:36:00.359685    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:36:00.362751 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:36:00.362733    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:39:48.104417 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.104381    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"]
Jul 31 00:39:48.104882 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.104755    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a493bc7-a619-48fc-8fac-eb63924b2835" containerName="cleanup"
Jul 31 00:39:48.104882 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.104768    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a493bc7-a619-48fc-8fac-eb63924b2835" containerName="cleanup"
Jul 31 00:39:48.104882 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.104844    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a493bc7-a619-48fc-8fac-eb63924b2835" containerName="cleanup"
Jul 31 00:39:48.107733 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.107716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.110399 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.110376    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2c8c8809-openshift-default-dockercfg-lmgjv\""
Jul 31 00:39:48.127233 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.127207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"]
Jul 31 00:39:48.213403 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-data\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-socket\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-certs\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-podinfo\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4861d04e-4523-480a-8c4f-b54e926b6a58-istiod-ca-cert\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213741 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-credential-socket\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213741 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-envoy\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213741 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5fg8\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-kube-api-access-h5fg8\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.213841 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.213758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-token\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.314685 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.314646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-data\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.314685 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.314681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-socket\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.314887 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.314803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-certs\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.314887 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.314843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-podinfo\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.314887 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.314870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4861d04e-4523-480a-8c4f-b54e926b6a58-istiod-ca-cert\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315036 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.314906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-credential-socket\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315036 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.314961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-envoy\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315353 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.315056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5fg8\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-kube-api-access-h5fg8\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315461 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.315396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-token\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315461 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.315085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-data\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315461 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.315179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-certs\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315461 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.315258    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-credential-socket\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.315131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-socket\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.315699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.315550    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4861d04e-4523-480a-8c4f-b54e926b6a58-istiod-ca-cert\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.317193 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.317167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-envoy\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.317313 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.317289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-podinfo\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.322708 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.322683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-token\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.323067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.323047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5fg8\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-kube-api-access-h5fg8\") pod \"e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") " pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.417318 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.417223    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:48.549235 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.549197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"]
Jul 31 00:39:48.549895 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:39:48.549869    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4861d04e_4523_480a_8c4f_b54e926b6a58.slice/crio-16ebb2238b5dad8f61760193ec11d7e2dae667c13a523081cff8c1bdd705c084 WatchSource:0}: Error finding container 16ebb2238b5dad8f61760193ec11d7e2dae667c13a523081cff8c1bdd705c084: Status 404 returned error can't find the container with id 16ebb2238b5dad8f61760193ec11d7e2dae667c13a523081cff8c1bdd705c084
Jul 31 00:39:48.552094 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.552051    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:39:48.552194 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.552129    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:39:48.552194 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:48.552173    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:39:49.296075 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:49.296040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" event={"ID":"4861d04e-4523-480a-8c4f-b54e926b6a58","Type":"ContainerStarted","Data":"4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5"}
Jul 31 00:39:49.296458 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:49.296091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" event={"ID":"4861d04e-4523-480a-8c4f-b54e926b6a58","Type":"ContainerStarted","Data":"16ebb2238b5dad8f61760193ec11d7e2dae667c13a523081cff8c1bdd705c084"}
Jul 31 00:39:49.315490 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:49.315443    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" podStartSLOduration=1.315428534 podStartE2EDuration="1.315428534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:39:49.314655959 +0000 UTC m=+2029.591898942" watchObservedRunningTime="2026-07-31 00:39:49.315428534 +0000 UTC m=+2029.592671520"
Jul 31 00:39:49.418160 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:49.418123    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:49.431030 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:49.431003    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:50.301077 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:50.301042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:50.302322 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:50.302302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:39:51.721036 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.721004    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"]
Jul 31 00:39:51.724646 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.724609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.727190 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.727170    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2c8c8809-serving-cert\""
Jul 31 00:39:51.727319 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.727281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:39:51.733946 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.733876    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"]
Jul 31 00:39:51.850392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.850359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a726e5f3-0e0a-430b-8379-4ed8959174df-openshift-service-ca\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.850562 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.850398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.850562 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.850521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mks52\" (UniqueName: \"kubernetes.io/projected/a726e5f3-0e0a-430b-8379-4ed8959174df-kube-api-access-mks52\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.951755 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.951719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mks52\" (UniqueName: \"kubernetes.io/projected/a726e5f3-0e0a-430b-8379-4ed8959174df-kube-api-access-mks52\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.951950 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.951784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a726e5f3-0e0a-430b-8379-4ed8959174df-openshift-service-ca\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.951950 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.951806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.951950 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:39:51.951919    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-serving-cert: secret "maas-api-e2e-ait-2c8c8809-serving-cert" not found
Jul 31 00:39:51.952143 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:39:51.951991    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls podName:a726e5f3-0e0a-430b-8379-4ed8959174df nodeName:}" failed. No retries permitted until 2026-07-31 00:39:52.451974946 +0000 UTC m=+2032.729217912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls") pod "maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" (UID: "a726e5f3-0e0a-430b-8379-4ed8959174df") : secret "maas-api-e2e-ait-2c8c8809-serving-cert" not found
Jul 31 00:39:51.952466 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.952440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a726e5f3-0e0a-430b-8379-4ed8959174df-openshift-service-ca\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:51.960547 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:51.960525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mks52\" (UniqueName: \"kubernetes.io/projected/a726e5f3-0e0a-430b-8379-4ed8959174df-kube-api-access-mks52\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:52.456818 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:52.456778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:52.457027 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:39:52.456896    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-serving-cert: secret "maas-api-e2e-ait-2c8c8809-serving-cert" not found
Jul 31 00:39:52.457027 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:39:52.456963    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls podName:a726e5f3-0e0a-430b-8379-4ed8959174df nodeName:}" failed. No retries permitted until 2026-07-31 00:39:53.456945752 +0000 UTC m=+2033.734188719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls") pod "maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" (UID: "a726e5f3-0e0a-430b-8379-4ed8959174df") : secret "maas-api-e2e-ait-2c8c8809-serving-cert" not found
Jul 31 00:39:53.467460 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:53.467416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:53.469777 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:53.469758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls\") pod \"maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:53.536994 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:53.536962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:53.876123 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:53.876098    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"]
Jul 31 00:39:53.877535 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:39:53.877508    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda726e5f3_0e0a_430b_8379_4ed8959174df.slice/crio-73995682b374ba72fa0a19e45483db18f2f7137906fc1816801e39c63f5070b4 WatchSource:0}: Error finding container 73995682b374ba72fa0a19e45483db18f2f7137906fc1816801e39c63f5070b4: Status 404 returned error can't find the container with id 73995682b374ba72fa0a19e45483db18f2f7137906fc1816801e39c63f5070b4
Jul 31 00:39:53.879275 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:53.879259    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:39:54.322883 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:54.322850    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" event={"ID":"a726e5f3-0e0a-430b-8379-4ed8959174df","Type":"ContainerStarted","Data":"73995682b374ba72fa0a19e45483db18f2f7137906fc1816801e39c63f5070b4"}
Jul 31 00:39:55.332892 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:55.332842    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" event={"ID":"a726e5f3-0e0a-430b-8379-4ed8959174df","Type":"ContainerStarted","Data":"76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa"}
Jul 31 00:39:55.333847 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:55.333820    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:39:55.352234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:39:55.352182    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" podStartSLOduration=3.876422662 podStartE2EDuration="4.352162963s" totalImagesPullingTime="475.740301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:39:55.349035323 +0000 UTC m=+2035.626278313" watchObservedRunningTime="2026-07-31 00:39:55.352162963 +0000 UTC m=+2035.629405951"
Jul 31 00:40:02.355343 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:02.355311    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:40:04.389746 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:04.389717    2582 generic.go:356] "Generic (PLEG): container finished" podID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerID="4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5" exitCode=0
Jul 31 00:40:04.390166 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:04.389791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" event={"ID":"4861d04e-4523-480a-8c4f-b54e926b6a58","Type":"ContainerDied","Data":"4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5"}
Jul 31 00:40:04.390166 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:04.390162    2582 scope.go:117] "RemoveContainer" containerID="4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5"
Jul 31 00:40:04.391234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:04.391209    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:40:04.391297 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:04.391274    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:40:04.391335 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:04.391326    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:40:05.301207 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:05.301172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:40:05.396823 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:05.396788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" event={"ID":"4861d04e-4523-480a-8c4f-b54e926b6a58","Type":"ContainerStarted","Data":"d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4"}
Jul 31 00:40:05.418153 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:05.418121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:40:05.419255 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:05.419232    2582 patch_prober.go:28] interesting pod/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 31 00:40:05.419348 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:05.419294    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 31 00:40:06.417497 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:06.417464    2582 patch_prober.go:28] interesting pod/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 31 00:40:06.417893 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:06.417515    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 31 00:40:07.417740 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:07.417708    2582 patch_prober.go:28] interesting pod/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 31 00:40:07.418124 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:07.417772    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 31 00:40:08.417827 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:08.417788    2582 patch_prober.go:28] interesting pod/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 31 00:40:08.418312 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:08.417868    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 31 00:40:09.418361 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:09.418326    2582 patch_prober.go:28] interesting pod/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 31 00:40:09.418741 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:09.418387    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 31 00:40:10.422562 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:10.422524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:40:10.423009 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:10.422830    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:40:10.423656 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:10.423619    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:40:32.259502 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.259420    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"]
Jul 31 00:40:32.260046 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.259700    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" podUID="a726e5f3-0e0a-430b-8379-4ed8959174df" containerName="maas-api" containerID="cri-o://76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa" gracePeriod=30
Jul 31 00:40:32.351100 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.351064    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" podUID="a726e5f3-0e0a-430b-8379-4ed8959174df" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.45:8443/health\": dial tcp 10.132.0.45:8443: connect: connection refused"
Jul 31 00:40:32.511935 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.511870    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:40:32.546589 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.546551    2582 generic.go:356] "Generic (PLEG): container finished" podID="a726e5f3-0e0a-430b-8379-4ed8959174df" containerID="76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa" exitCode=0
Jul 31 00:40:32.546802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.546608    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"
Jul 31 00:40:32.546802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.546664    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" event={"ID":"a726e5f3-0e0a-430b-8379-4ed8959174df","Type":"ContainerDied","Data":"76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa"}
Jul 31 00:40:32.546802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.546726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l" event={"ID":"a726e5f3-0e0a-430b-8379-4ed8959174df","Type":"ContainerDied","Data":"73995682b374ba72fa0a19e45483db18f2f7137906fc1816801e39c63f5070b4"}
Jul 31 00:40:32.546802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.546760    2582 scope.go:117] "RemoveContainer" containerID="76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa"
Jul 31 00:40:32.556434 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.556413    2582 scope.go:117] "RemoveContainer" containerID="76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa"
Jul 31 00:40:32.556819 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:40:32.556781    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa\": container with ID starting with 76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa not found: ID does not exist" containerID="76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa"
Jul 31 00:40:32.556928 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.556844    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa"} err="failed to get container status \"76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa\": rpc error: code = NotFound desc = could not find container \"76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa\": container with ID starting with 76c25d64228f05e3c3b678a677f0c9194d47a4d5bd0fa8522d573ac19d10feaa not found: ID does not exist"
Jul 31 00:40:32.585820 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.585777    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"]
Jul 31 00:40:32.586066 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.586033    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy" containerID="cri-o://d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4" gracePeriod=30
Jul 31 00:40:32.619074 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.618984    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls\") pod \"a726e5f3-0e0a-430b-8379-4ed8959174df\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") "
Jul 31 00:40:32.619234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.619145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mks52\" (UniqueName: \"kubernetes.io/projected/a726e5f3-0e0a-430b-8379-4ed8959174df-kube-api-access-mks52\") pod \"a726e5f3-0e0a-430b-8379-4ed8959174df\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") "
Jul 31 00:40:32.619234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.619185    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a726e5f3-0e0a-430b-8379-4ed8959174df-openshift-service-ca\") pod \"a726e5f3-0e0a-430b-8379-4ed8959174df\" (UID: \"a726e5f3-0e0a-430b-8379-4ed8959174df\") "
Jul 31 00:40:32.619592 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.619535    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a726e5f3-0e0a-430b-8379-4ed8959174df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a726e5f3-0e0a-430b-8379-4ed8959174df" (UID: "a726e5f3-0e0a-430b-8379-4ed8959174df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:40:32.621135 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.621103    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a726e5f3-0e0a-430b-8379-4ed8959174df" (UID: "a726e5f3-0e0a-430b-8379-4ed8959174df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:40:32.621262 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.621237    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a726e5f3-0e0a-430b-8379-4ed8959174df-kube-api-access-mks52" (OuterVolumeSpecName: "kube-api-access-mks52") pod "a726e5f3-0e0a-430b-8379-4ed8959174df" (UID: "a726e5f3-0e0a-430b-8379-4ed8959174df"). InnerVolumeSpecName "kube-api-access-mks52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:40:32.720597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.720564    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a726e5f3-0e0a-430b-8379-4ed8959174df-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:32.720597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.720592    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mks52\" (UniqueName: \"kubernetes.io/projected/a726e5f3-0e0a-430b-8379-4ed8959174df-kube-api-access-mks52\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:32.720597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.720604    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a726e5f3-0e0a-430b-8379-4ed8959174df-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:32.868926 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.868894    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"]
Jul 31 00:40:32.873989 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:32.873965    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2c8c8809-786dd848db-2jf5l"]
Jul 31 00:40:34.250746 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:34.250712    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a726e5f3-0e0a-430b-8379-4ed8959174df" path="/var/lib/kubelet/pods/a726e5f3-0e0a-430b-8379-4ed8959174df/volumes"
Jul 31 00:40:35.981934 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.981902    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"]
Jul 31 00:40:35.982320 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.982270    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a726e5f3-0e0a-430b-8379-4ed8959174df" containerName="maas-api"
Jul 31 00:40:35.982320 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.982281    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a726e5f3-0e0a-430b-8379-4ed8959174df" containerName="maas-api"
Jul 31 00:40:35.982411 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.982340    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a726e5f3-0e0a-430b-8379-4ed8959174df" containerName="maas-api"
Jul 31 00:40:35.985325 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.985307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:35.987958 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.987939    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5c18c4ee-serving-cert\""
Jul 31 00:40:35.987958 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.987955    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:40:35.994278 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:35.994255    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"]
Jul 31 00:40:36.154641 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.154588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd8hr\" (UniqueName: \"kubernetes.io/projected/17eaf29c-1780-405d-b706-f2756473a96a-kube-api-access-jd8hr\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.154799 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.154651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17eaf29c-1780-405d-b706-f2756473a96a-maas-api-tls\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.154799 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.154699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17eaf29c-1780-405d-b706-f2756473a96a-openshift-service-ca\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.255773 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.255747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd8hr\" (UniqueName: \"kubernetes.io/projected/17eaf29c-1780-405d-b706-f2756473a96a-kube-api-access-jd8hr\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.255934 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.255785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17eaf29c-1780-405d-b706-f2756473a96a-maas-api-tls\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.255934 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.255836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17eaf29c-1780-405d-b706-f2756473a96a-openshift-service-ca\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.256459 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.256433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17eaf29c-1780-405d-b706-f2756473a96a-openshift-service-ca\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.258280 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.258259    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17eaf29c-1780-405d-b706-f2756473a96a-maas-api-tls\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.263068 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.263047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd8hr\" (UniqueName: \"kubernetes.io/projected/17eaf29c-1780-405d-b706-f2756473a96a-kube-api-access-jd8hr\") pod \"maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.298018 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.297996    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:36.449723 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.449695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"]
Jul 31 00:40:36.450782 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:40:36.450757    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17eaf29c_1780_405d_b706_f2756473a96a.slice/crio-0fce544acfe554117f1757029237a5aeb494a77c85055ad0760587cfacb5161f WatchSource:0}: Error finding container 0fce544acfe554117f1757029237a5aeb494a77c85055ad0760587cfacb5161f: Status 404 returned error can't find the container with id 0fce544acfe554117f1757029237a5aeb494a77c85055ad0760587cfacb5161f
Jul 31 00:40:36.580371 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:36.580275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8" event={"ID":"17eaf29c-1780-405d-b706-f2756473a96a","Type":"ContainerStarted","Data":"0fce544acfe554117f1757029237a5aeb494a77c85055ad0760587cfacb5161f"}
Jul 31 00:40:37.587571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.587538    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8" event={"ID":"17eaf29c-1780-405d-b706-f2756473a96a","Type":"ContainerStarted","Data":"ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a"}
Jul 31 00:40:37.588020 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.587679    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:40:37.604318 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.604266    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8" podStartSLOduration=2.308778633 podStartE2EDuration="2.604251402s" totalImagesPullingTime="295.472769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:40:37.602396995 +0000 UTC m=+2077.879639986" watchObservedRunningTime="2026-07-31 00:40:37.604251402 +0000 UTC m=+2077.881494392"
Jul 31 00:40:37.845665 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.845594    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:40:37.973171 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973139    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-podinfo\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973371 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973180    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-data\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973371 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973211    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-credential-socket\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973371 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973234    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5fg8\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-kube-api-access-h5fg8\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973544 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973367    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-envoy\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973544 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4861d04e-4523-480a-8c4f-b54e926b6a58-istiod-ca-cert\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973692 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973551    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-data" (OuterVolumeSpecName: "istio-data") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:40:37.973692 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973564    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-certs\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973692 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973564    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:40:37.973692 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973606    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-socket\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973692 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973663    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-token\") pod \"4861d04e-4523-480a-8c4f-b54e926b6a58\" (UID: \"4861d04e-4523-480a-8c4f-b54e926b6a58\") "
Jul 31 00:40:37.973919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:40:37.973919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973861    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:40:37.973919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.973910    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4861d04e-4523-480a-8c4f-b54e926b6a58-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:40:37.974067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.974035    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4861d04e-4523-480a-8c4f-b54e926b6a58-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:37.974067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.974049    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:37.974067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.974058    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:37.974067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.974066    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:37.974224 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.974073    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:37.975463 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.975438    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:40:37.975655 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.975611    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-token" (OuterVolumeSpecName: "istio-token") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:40:37.975819 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.975796    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-kube-api-access-h5fg8" (OuterVolumeSpecName: "kube-api-access-h5fg8") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "kube-api-access-h5fg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:40:37.975866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:37.975839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4861d04e-4523-480a-8c4f-b54e926b6a58" (UID: "4861d04e-4523-480a-8c4f-b54e926b6a58"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 00:40:38.074888 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.074858    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:38.074888 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.074882    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:38.074888 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.074892    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5fg8\" (UniqueName: \"kubernetes.io/projected/4861d04e-4523-480a-8c4f-b54e926b6a58-kube-api-access-h5fg8\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:38.075122 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.074902    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4861d04e-4523-480a-8c4f-b54e926b6a58-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:40:38.595235 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.595140    2582 generic.go:356] "Generic (PLEG): container finished" podID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerID="d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4" exitCode=0
Jul 31 00:40:38.595235 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.595197    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"
Jul 31 00:40:38.595775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.595233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" event={"ID":"4861d04e-4523-480a-8c4f-b54e926b6a58","Type":"ContainerDied","Data":"d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4"}
Jul 31 00:40:38.595775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.595303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx" event={"ID":"4861d04e-4523-480a-8c4f-b54e926b6a58","Type":"ContainerDied","Data":"16ebb2238b5dad8f61760193ec11d7e2dae667c13a523081cff8c1bdd705c084"}
Jul 31 00:40:38.595775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.595339    2582 scope.go:117] "RemoveContainer" containerID="d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4"
Jul 31 00:40:38.604511 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.604493    2582 scope.go:117] "RemoveContainer" containerID="4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5"
Jul 31 00:40:38.613053 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.613021    2582 scope.go:117] "RemoveContainer" containerID="d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4"
Jul 31 00:40:38.613369 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:40:38.613344    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4\": container with ID starting with d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4 not found: ID does not exist" containerID="d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4"
Jul 31 00:40:38.613432 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.613380    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4"} err="failed to get container status \"d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4\": rpc error: code = NotFound desc = could not find container \"d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4\": container with ID starting with d47de9e1d84fc3bd56f116fe79922b7fd582fbcb68632aac9b38f09f0a29f5d4 not found: ID does not exist"
Jul 31 00:40:38.613432 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.613404    2582 scope.go:117] "RemoveContainer" containerID="4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5"
Jul 31 00:40:38.613676 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:40:38.613656    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5\": container with ID starting with 4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5 not found: ID does not exist" containerID="4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5"
Jul 31 00:40:38.613747 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.613686    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5"} err="failed to get container status \"4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5\": rpc error: code = NotFound desc = could not find container \"4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5\": container with ID starting with 4f80e07e29ae5f9055f138680d42834bcfd92f1f82985fbfac720bfad2e494e5 not found: ID does not exist"
Jul 31 00:40:38.614875 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.614854    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"]
Jul 31 00:40:38.619739 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:38.619704    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2c8c8809-openshift-default-8c4ddfcd-hf4fx"]
Jul 31 00:40:40.248343 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:40.248309    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" path="/var/lib/kubelet/pods/4861d04e-4523-480a-8c4f-b54e926b6a58/volumes"
Jul 31 00:40:43.601275 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:40:43.601242    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:41:00.388812 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:00.388781    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:41:00.394276 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:00.394246    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:41:00.396411 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:00.396388    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:41:00.401440 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:00.401423    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:41:05.871566 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.871527    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"]
Jul 31 00:41:05.872531 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.872468    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy"
Jul 31 00:41:05.872531 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.872498    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy"
Jul 31 00:41:05.875013 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.872881    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy"
Jul 31 00:41:05.875013 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.872921    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy"
Jul 31 00:41:05.878504 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.877212    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"
Jul 31 00:41:05.881482 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.880305    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 00:41:05.885511 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.885491    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"]
Jul 31 00:41:05.915872 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:05.915834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk\" (UID: \"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"
Jul 31 00:41:06.016857 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:06.016820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk\" (UID: \"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"
Jul 31 00:41:06.017512 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:06.017478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk\" (UID: \"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"
Jul 31 00:41:06.192931 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:06.192853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"
Jul 31 00:41:06.326795 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:06.326765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"]
Jul 31 00:41:06.328796 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:41:06.328771    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3c6b2a_799b_45c1_8dbe_a0e21d5219eb.slice/crio-a21463560119210a6c07f8dfb87ee89f62470807a579589272418f54272ca1f0 WatchSource:0}: Error finding container a21463560119210a6c07f8dfb87ee89f62470807a579589272418f54272ca1f0: Status 404 returned error can't find the container with id a21463560119210a6c07f8dfb87ee89f62470807a579589272418f54272ca1f0
Jul 31 00:41:06.750328 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:06.750290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk" event={"ID":"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb","Type":"ContainerStarted","Data":"25c0476cadee31aee094275a19375379bfe2b8e922030054eb22831c18e8ac7b"}
Jul 31 00:41:06.750522 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:06.750357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk" event={"ID":"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb","Type":"ContainerStarted","Data":"a21463560119210a6c07f8dfb87ee89f62470807a579589272418f54272ca1f0"}
Jul 31 00:41:06.766230 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:06.766179    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk" podStartSLOduration=1.766163625 podStartE2EDuration="1.766163625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:06.765931285 +0000 UTC m=+2107.043174276" watchObservedRunningTime="2026-07-31 00:41:06.766163625 +0000 UTC m=+2107.043406614"
Jul 31 00:41:07.757578 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:07.757544    2582 generic.go:356] "Generic (PLEG): container finished" podID="6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb" containerID="25c0476cadee31aee094275a19375379bfe2b8e922030054eb22831c18e8ac7b" exitCode=0
Jul 31 00:41:07.757986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:07.757650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk" event={"ID":"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb","Type":"ContainerDied","Data":"25c0476cadee31aee094275a19375379bfe2b8e922030054eb22831c18e8ac7b"}
Jul 31 00:41:08.894892 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:08.894862    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"
Jul 31 00:41:08.944151 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:08.944112    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb-maas-api-service-ca\") pod \"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb\" (UID: \"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb\") "
Jul 31 00:41:08.944481 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:08.944457    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb" (UID: "6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:09.045610 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:09.045521    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:09.769075 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:09.769047    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"
Jul 31 00:41:09.769224 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:09.769038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk" event={"ID":"6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb","Type":"ContainerDied","Data":"a21463560119210a6c07f8dfb87ee89f62470807a579589272418f54272ca1f0"}
Jul 31 00:41:09.769224 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:09.769179    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a21463560119210a6c07f8dfb87ee89f62470807a579589272418f54272ca1f0"
Jul 31 00:41:16.531403 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.531371    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"]
Jul 31 00:41:16.531841 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.531610    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8" podUID="17eaf29c-1780-405d-b706-f2756473a96a" containerName="maas-api" containerID="cri-o://ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a" gracePeriod=30
Jul 31 00:41:16.714340 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.714309    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"]
Jul 31 00:41:16.717686 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.717656    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c18c4ee-577wk"]
Jul 31 00:41:16.794424 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.794368    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:41:16.808882 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.808858    2582 generic.go:356] "Generic (PLEG): container finished" podID="17eaf29c-1780-405d-b706-f2756473a96a" containerID="ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a" exitCode=0
Jul 31 00:41:16.808988 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.808901    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"
Jul 31 00:41:16.808988 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.808938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8" event={"ID":"17eaf29c-1780-405d-b706-f2756473a96a","Type":"ContainerDied","Data":"ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a"}
Jul 31 00:41:16.809067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.809020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8" event={"ID":"17eaf29c-1780-405d-b706-f2756473a96a","Type":"ContainerDied","Data":"0fce544acfe554117f1757029237a5aeb494a77c85055ad0760587cfacb5161f"}
Jul 31 00:41:16.809067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.809048    2582 scope.go:117] "RemoveContainer" containerID="ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a"
Jul 31 00:41:16.819525 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.819504    2582 scope.go:117] "RemoveContainer" containerID="ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a"
Jul 31 00:41:16.819828 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:16.819808    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a\": container with ID starting with ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a not found: ID does not exist" containerID="ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a"
Jul 31 00:41:16.819882 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.819838    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a"} err="failed to get container status \"ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a\": rpc error: code = NotFound desc = could not find container \"ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a\": container with ID starting with ae459949aafacfd0e174e3301a7e32b836ed6a67539112f358e45a2ca5a06c6a not found: ID does not exist"
Jul 31 00:41:16.915008 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.914975    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17eaf29c-1780-405d-b706-f2756473a96a-maas-api-tls\") pod \"17eaf29c-1780-405d-b706-f2756473a96a\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") "
Jul 31 00:41:16.915156 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.915062    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd8hr\" (UniqueName: \"kubernetes.io/projected/17eaf29c-1780-405d-b706-f2756473a96a-kube-api-access-jd8hr\") pod \"17eaf29c-1780-405d-b706-f2756473a96a\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") "
Jul 31 00:41:16.915156 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.915136    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17eaf29c-1780-405d-b706-f2756473a96a-openshift-service-ca\") pod \"17eaf29c-1780-405d-b706-f2756473a96a\" (UID: \"17eaf29c-1780-405d-b706-f2756473a96a\") "
Jul 31 00:41:16.915503 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.915479    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17eaf29c-1780-405d-b706-f2756473a96a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17eaf29c-1780-405d-b706-f2756473a96a" (UID: "17eaf29c-1780-405d-b706-f2756473a96a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:16.917025 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.916994    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17eaf29c-1780-405d-b706-f2756473a96a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17eaf29c-1780-405d-b706-f2756473a96a" (UID: "17eaf29c-1780-405d-b706-f2756473a96a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:41:16.917114 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:16.917079    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17eaf29c-1780-405d-b706-f2756473a96a-kube-api-access-jd8hr" (OuterVolumeSpecName: "kube-api-access-jd8hr") pod "17eaf29c-1780-405d-b706-f2756473a96a" (UID: "17eaf29c-1780-405d-b706-f2756473a96a"). InnerVolumeSpecName "kube-api-access-jd8hr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:17.016826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.016790    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17eaf29c-1780-405d-b706-f2756473a96a-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:17.016826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.016820    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd8hr\" (UniqueName: \"kubernetes.io/projected/17eaf29c-1780-405d-b706-f2756473a96a-kube-api-access-jd8hr\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:17.016826 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.016830    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17eaf29c-1780-405d-b706-f2756473a96a-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:17.135077 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.135046    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"]
Jul 31 00:41:17.139317 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.139291    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5c18c4ee-55b7f6d74b-hwcm8"]
Jul 31 00:41:17.642395 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642361    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"]
Jul 31 00:41:17.642890 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642862    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17eaf29c-1780-405d-b706-f2756473a96a" containerName="maas-api"
Jul 31 00:41:17.642890 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642879    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="17eaf29c-1780-405d-b706-f2756473a96a" containerName="maas-api"
Jul 31 00:41:17.643005 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642897    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy"
Jul 31 00:41:17.643005 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642903    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4861d04e-4523-480a-8c4f-b54e926b6a58" containerName="istio-proxy"
Jul 31 00:41:17.643005 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642923    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb" containerName="revoke-keys"
Jul 31 00:41:17.643005 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642929    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb" containerName="revoke-keys"
Jul 31 00:41:17.643005 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.642987    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb" containerName="revoke-keys"
Jul 31 00:41:17.643005 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.643002    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="17eaf29c-1780-405d-b706-f2756473a96a" containerName="maas-api"
Jul 31 00:41:17.647384 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.647362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.649934 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.649914    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eee00287-openshift-default-dockercfg-vcwmp\""
Jul 31 00:41:17.658820 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.658797    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"]
Jul 31 00:41:17.723752 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-credential-socket\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.723892 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-certs\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.723892 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-istio-token\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.723892 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-envoy\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.723892 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-socket\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.724048 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea78685-974d-4b44-80b9-f7326b74cca4-istiod-ca-cert\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.724048 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea78685-974d-4b44-80b9-f7326b74cca4-istio-podinfo\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.724048 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.723968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z8bf\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-kube-api-access-8z8bf\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.724048 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.724031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-data\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.824608 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea78685-974d-4b44-80b9-f7326b74cca4-istiod-ca-cert\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.824784 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea78685-974d-4b44-80b9-f7326b74cca4-istio-podinfo\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.824784 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z8bf\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-kube-api-access-8z8bf\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.824784 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-data\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.824784 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-credential-socket\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-certs\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-istio-token\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-envoy\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.824934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-socket\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825228 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.825203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-data\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825559 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.825523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea78685-974d-4b44-80b9-f7326b74cca4-istiod-ca-cert\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825713 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.825615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-socket\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825713 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.825677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-credential-socket\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.825713 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.825698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-certs\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.827673 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.827653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-envoy\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.827929 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.827905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea78685-974d-4b44-80b9-f7326b74cca4-istio-podinfo\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.833097 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.833075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-istio-token\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.833706 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.833684    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z8bf\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-kube-api-access-8z8bf\") pod \"e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") " pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:17.960400 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:17.960320    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:18.087404 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.087373    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"]
Jul 31 00:41:18.088486 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:41:18.088464    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea78685_974d_4b44_80b9_f7326b74cca4.slice/crio-798e43945b470208db5e7aa38c928c0f47ec0bda5e9eb1de05ded2c003df7bc6 WatchSource:0}: Error finding container 798e43945b470208db5e7aa38c928c0f47ec0bda5e9eb1de05ded2c003df7bc6: Status 404 returned error can't find the container with id 798e43945b470208db5e7aa38c928c0f47ec0bda5e9eb1de05ded2c003df7bc6
Jul 31 00:41:18.090560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.090529    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:41:18.090691 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.090594    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:41:18.090691 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.090643    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:41:18.249129 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.249046    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17eaf29c-1780-405d-b706-f2756473a96a" path="/var/lib/kubelet/pods/17eaf29c-1780-405d-b706-f2756473a96a/volumes"
Jul 31 00:41:18.249574 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.249553    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb" path="/var/lib/kubelet/pods/6d3c6b2a-799b-45c1-8dbe-a0e21d5219eb/volumes"
Jul 31 00:41:18.824205 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.824162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" event={"ID":"eea78685-974d-4b44-80b9-f7326b74cca4","Type":"ContainerStarted","Data":"7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d"}
Jul 31 00:41:18.824689 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.824221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" event={"ID":"eea78685-974d-4b44-80b9-f7326b74cca4","Type":"ContainerStarted","Data":"798e43945b470208db5e7aa38c928c0f47ec0bda5e9eb1de05ded2c003df7bc6"}
Jul 31 00:41:18.845245 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.845197    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podStartSLOduration=1.845180902 podStartE2EDuration="1.845180902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:18.843165554 +0000 UTC m=+2119.120408542" watchObservedRunningTime="2026-07-31 00:41:18.845180902 +0000 UTC m=+2119.122423891"
Jul 31 00:41:18.960653 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:18.960607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:19.965379 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:19.965353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:20.835079 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:20.835033    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:20.836093 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:20.836071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:21.285833 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.285804    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"]
Jul 31 00:41:21.289441 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.289424    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.292055 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.292030    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-eee00287-serving-cert\""
Jul 31 00:41:21.292187 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.292098    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:41:21.297084 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.297063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"]
Jul 31 00:41:21.455815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.455780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.455973 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.455832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgd8m\" (UniqueName: \"kubernetes.io/projected/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-kube-api-access-kgd8m\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.456031 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.455972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-openshift-service-ca\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.557510 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.557426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.557510 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.557466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgd8m\" (UniqueName: \"kubernetes.io/projected/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-kube-api-access-kgd8m\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.557769 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.557530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-openshift-service-ca\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.557769 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:21.557567    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-serving-cert: secret "maas-api-e2e-ait-eee00287-serving-cert" not found
Jul 31 00:41:21.557769 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:21.557666    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls podName:6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55 nodeName:}" failed. No retries permitted until 2026-07-31 00:41:22.057643774 +0000 UTC m=+2122.334886760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls") pod "maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" (UID: "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55") : secret "maas-api-e2e-ait-eee00287-serving-cert" not found
Jul 31 00:41:21.558149 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.558132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-openshift-service-ca\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:21.570348 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:21.570323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgd8m\" (UniqueName: \"kubernetes.io/projected/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-kube-api-access-kgd8m\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:22.063867 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:22.063177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:22.063867 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:22.063403    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-serving-cert: secret "maas-api-e2e-ait-eee00287-serving-cert" not found
Jul 31 00:41:22.063867 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:22.063468    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls podName:6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55 nodeName:}" failed. No retries permitted until 2026-07-31 00:41:23.063449249 +0000 UTC m=+2123.340692218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls") pod "maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" (UID: "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55") : secret "maas-api-e2e-ait-eee00287-serving-cert" not found
Jul 31 00:41:23.072858 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.072827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:23.075118 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.075094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls\") pod \"maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:23.102722 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.102696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:23.231754 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.231723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"]
Jul 31 00:41:23.233203 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:41:23.233170    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9640c7_b9f3_4dd8_9eb2_28a4d37ddf55.slice/crio-e460bb10e1a0cef59672a55c91f81cdf52e33d561e5522a96dba6ba8127b3492 WatchSource:0}: Error finding container e460bb10e1a0cef59672a55c91f81cdf52e33d561e5522a96dba6ba8127b3492: Status 404 returned error can't find the container with id e460bb10e1a0cef59672a55c91f81cdf52e33d561e5522a96dba6ba8127b3492
Jul 31 00:41:23.852937 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.852906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" event={"ID":"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55","Type":"ContainerStarted","Data":"5b0e3bab20d76d23b5c70e40370cd918f7c66d40ff494be4491028c981c70725"}
Jul 31 00:41:23.853069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.852959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" event={"ID":"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55","Type":"ContainerStarted","Data":"e460bb10e1a0cef59672a55c91f81cdf52e33d561e5522a96dba6ba8127b3492"}
Jul 31 00:41:23.853069 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.853039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:23.869327 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:23.869272    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" podStartSLOduration=2.459475587 podStartE2EDuration="2.869255143s" totalImagesPullingTime="409.779556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:23.868149192 +0000 UTC m=+2124.145392184" watchObservedRunningTime="2026-07-31 00:41:23.869255143 +0000 UTC m=+2124.146498132"
Jul 31 00:41:29.863903 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:29.863872    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:34.921424 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:34.921388    2582 generic.go:356] "Generic (PLEG): container finished" podID="eea78685-974d-4b44-80b9-f7326b74cca4" containerID="7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d" exitCode=0
Jul 31 00:41:34.921860 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:34.921463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" event={"ID":"eea78685-974d-4b44-80b9-f7326b74cca4","Type":"ContainerDied","Data":"7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d"}
Jul 31 00:41:34.921860 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:34.921826    2582 scope.go:117] "RemoveContainer" containerID="7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d"
Jul 31 00:41:34.922782 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:34.922755    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:41:34.922842 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:34.922823    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:41:34.922882 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:34.922854    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:41:35.835745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:35.835700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:35.933098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:35.933052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" event={"ID":"eea78685-974d-4b44-80b9-f7326b74cca4","Type":"ContainerStarted","Data":"54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2"}
Jul 31 00:41:35.960695 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:35.960659    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:35.961662 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:35.961617    2582 patch_prober.go:28] interesting pod/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 31 00:41:35.961754 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:35.961687    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 31 00:41:36.961369 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:36.961330    2582 patch_prober.go:28] interesting pod/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 31 00:41:36.961874 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:36.961384    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 31 00:41:37.961664 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:37.961609    2582 patch_prober.go:28] interesting pod/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 31 00:41:37.962047 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:37.961689    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 31 00:41:38.961521 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:38.961485    2582 patch_prober.go:28] interesting pod/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 31 00:41:38.961719 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:38.961540    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 31 00:41:39.960774 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:39.960742    2582 patch_prober.go:28] interesting pod/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 31 00:41:39.960947 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:39.960797    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 31 00:41:40.964936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:40.964906    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:40.965407 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:40.965254    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:40.965842 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:40.965824    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:51.837883 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:51.837843    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"]
Jul 31 00:41:51.838345 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:51.838111    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" podUID="6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" containerName="maas-api" containerID="cri-o://5b0e3bab20d76d23b5c70e40370cd918f7c66d40ff494be4491028c981c70725" gracePeriod=30
Jul 31 00:41:52.028346 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.028280    2582 generic.go:356] "Generic (PLEG): container finished" podID="6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" containerID="5b0e3bab20d76d23b5c70e40370cd918f7c66d40ff494be4491028c981c70725" exitCode=0
Jul 31 00:41:52.028497 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.028349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" event={"ID":"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55","Type":"ContainerDied","Data":"5b0e3bab20d76d23b5c70e40370cd918f7c66d40ff494be4491028c981c70725"}
Jul 31 00:41:52.100274 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.100208    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:52.147466 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.147430    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-openshift-service-ca\") pod \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") "
Jul 31 00:41:52.147689 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.147513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgd8m\" (UniqueName: \"kubernetes.io/projected/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-kube-api-access-kgd8m\") pod \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") "
Jul 31 00:41:52.147689 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.147606    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls\") pod \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\" (UID: \"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55\") "
Jul 31 00:41:52.147901 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.147871    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" (UID: "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:52.149710 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.149683    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-kube-api-access-kgd8m" (OuterVolumeSpecName: "kube-api-access-kgd8m") pod "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" (UID: "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55"). InnerVolumeSpecName "kube-api-access-kgd8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:52.149798 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.149722    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" (UID: "6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:41:52.248637 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.248598    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:52.248637 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.248635    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgd8m\" (UniqueName: \"kubernetes.io/projected/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-kube-api-access-kgd8m\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:52.248830 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:52.248650    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:53.035351 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:53.035312    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj" event={"ID":"6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55","Type":"ContainerDied","Data":"e460bb10e1a0cef59672a55c91f81cdf52e33d561e5522a96dba6ba8127b3492"}
Jul 31 00:41:53.035351 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:53.035336    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"
Jul 31 00:41:53.035930 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:53.035375    2582 scope.go:117] "RemoveContainer" containerID="5b0e3bab20d76d23b5c70e40370cd918f7c66d40ff494be4491028c981c70725"
Jul 31 00:41:53.053077 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:53.053052    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"]
Jul 31 00:41:53.055361 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:53.055339    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eee00287-8bc54f87f-m2nxj"]
Jul 31 00:41:53.207219 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:53.207189    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"]
Jul 31 00:41:53.207414 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:53.207391    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy" containerID="cri-o://54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2" gracePeriod=30
Jul 31 00:41:54.249077 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:54.249048    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" path="/var/lib/kubelet/pods/6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55/volumes"
Jul 31 00:41:55.974284 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:55.974247    2582 patch_prober.go:28] interesting pod/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 31 00:41:55.974702 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:55.974313    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 00:41:57.138523 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.138491    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"]
Jul 31 00:41:57.139013 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.138926    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" containerName="maas-api"
Jul 31 00:41:57.139013 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.138939    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" containerName="maas-api"
Jul 31 00:41:57.139013 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.139010    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e9640c7-b9f3-4dd8-9eb2-28a4d37ddf55" containerName="maas-api"
Jul 31 00:41:57.141646 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.141612    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.144238 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.144217    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:41:57.144238 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.144234    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-eeb90a6e-serving-cert\""
Jul 31 00:41:57.152914 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.152889    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"]
Jul 31 00:41:57.191959 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.191930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.192115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.191994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq75m\" (UniqueName: \"kubernetes.io/projected/da5a901e-0552-479e-804c-a8a35a0eba69-kube-api-access-gq75m\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.192115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.192043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5a901e-0552-479e-804c-a8a35a0eba69-openshift-service-ca\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.293381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.293347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.293551 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.293401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq75m\" (UniqueName: \"kubernetes.io/projected/da5a901e-0552-479e-804c-a8a35a0eba69-kube-api-access-gq75m\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.293551 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.293444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5a901e-0552-479e-804c-a8a35a0eba69-openshift-service-ca\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.293551 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:57.293508    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-serving-cert: secret "maas-api-e2e-derive-eeb90a6e-serving-cert" not found
Jul 31 00:41:57.293694 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:57.293569    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls podName:da5a901e-0552-479e-804c-a8a35a0eba69 nodeName:}" failed. No retries permitted until 2026-07-31 00:41:57.793552747 +0000 UTC m=+2158.070795714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls") pod "maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk" (UID: "da5a901e-0552-479e-804c-a8a35a0eba69") : secret "maas-api-e2e-derive-eeb90a6e-serving-cert" not found
Jul 31 00:41:57.294133 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.294116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5a901e-0552-479e-804c-a8a35a0eba69-openshift-service-ca\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.302106 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.302079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq75m\" (UniqueName: \"kubernetes.io/projected/da5a901e-0552-479e-804c-a8a35a0eba69-kube-api-access-gq75m\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.797582 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.797548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:57.800102 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:57.800067    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls\") pod \"maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:58.054684 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.054569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:58.185298 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.185262    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"]
Jul 31 00:41:58.186262 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:41:58.186238    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5a901e_0552_479e_804c_a8a35a0eba69.slice/crio-891112484cb60753819a2ca63615c306d9d0e2552f565434ebd52f83081bd0b7 WatchSource:0}: Error finding container 891112484cb60753819a2ca63615c306d9d0e2552f565434ebd52f83081bd0b7: Status 404 returned error can't find the container with id 891112484cb60753819a2ca63615c306d9d0e2552f565434ebd52f83081bd0b7
Jul 31 00:41:58.455866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.455836    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:58.504618 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.504583    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-credential-socket\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.504791 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.504680    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-data\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.504918 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.504872    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:41:58.504962 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.504927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-data" (OuterVolumeSpecName: "istio-data") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:41:58.605219 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605132    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-envoy\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.605219 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605174    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea78685-974d-4b44-80b9-f7326b74cca4-istio-podinfo\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.605219 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605216    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-istio-token\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.605451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605255    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-socket\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.605451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605300    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-certs\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.605451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605332    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea78685-974d-4b44-80b9-f7326b74cca4-istiod-ca-cert\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.605451 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z8bf\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-kube-api-access-8z8bf\") pod \"eea78685-974d-4b44-80b9-f7326b74cca4\" (UID: \"eea78685-974d-4b44-80b9-f7326b74cca4\") "
Jul 31 00:41:58.605696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605576    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:41:58.605696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:41:58.605696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605665    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.605696 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605685    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.605877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.605742    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea78685-974d-4b44-80b9-f7326b74cca4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:41:58.607558 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.607532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eea78685-974d-4b44-80b9-f7326b74cca4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 00:41:58.607679 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.607560    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-kube-api-access-8z8bf" (OuterVolumeSpecName: "kube-api-access-8z8bf") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "kube-api-access-8z8bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:58.607900 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.607876    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-istio-token" (OuterVolumeSpecName: "istio-token") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:41:58.607971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.607879    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eea78685-974d-4b44-80b9-f7326b74cca4" (UID: "eea78685-974d-4b44-80b9-f7326b74cca4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:41:58.706120 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.706094    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.706120 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.706119    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eea78685-974d-4b44-80b9-f7326b74cca4-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.706272 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.706131    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.706272 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.706142    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.706272 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.706153    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea78685-974d-4b44-80b9-f7326b74cca4-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.706272 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.706164    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eea78685-974d-4b44-80b9-f7326b74cca4-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:58.706272 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:58.706175    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z8bf\" (UniqueName: \"kubernetes.io/projected/eea78685-974d-4b44-80b9-f7326b74cca4-kube-api-access-8z8bf\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:41:59.072041 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.072000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk" event={"ID":"da5a901e-0552-479e-804c-a8a35a0eba69","Type":"ContainerStarted","Data":"39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90"}
Jul 31 00:41:59.072250 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.072062    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:41:59.072250 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.072086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk" event={"ID":"da5a901e-0552-479e-804c-a8a35a0eba69","Type":"ContainerStarted","Data":"891112484cb60753819a2ca63615c306d9d0e2552f565434ebd52f83081bd0b7"}
Jul 31 00:41:59.073613 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.073588    2582 generic.go:356] "Generic (PLEG): container finished" podID="eea78685-974d-4b44-80b9-f7326b74cca4" containerID="54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2" exitCode=0
Jul 31 00:41:59.073768 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.073661    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"
Jul 31 00:41:59.073768 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.073673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" event={"ID":"eea78685-974d-4b44-80b9-f7326b74cca4","Type":"ContainerDied","Data":"54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2"}
Jul 31 00:41:59.073768 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.073719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c" event={"ID":"eea78685-974d-4b44-80b9-f7326b74cca4","Type":"ContainerDied","Data":"798e43945b470208db5e7aa38c928c0f47ec0bda5e9eb1de05ded2c003df7bc6"}
Jul 31 00:41:59.073768 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.073741    2582 scope.go:117] "RemoveContainer" containerID="54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2"
Jul 31 00:41:59.083170 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.083154    2582 scope.go:117] "RemoveContainer" containerID="7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d"
Jul 31 00:41:59.088356 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.088314    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk" podStartSLOduration=1.631742763 podStartE2EDuration="2.088301327s" totalImagesPullingTime="456.558564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:41:59.086992241 +0000 UTC m=+2159.364235231" watchObservedRunningTime="2026-07-31 00:41:59.088301327 +0000 UTC m=+2159.365544342"
Jul 31 00:41:59.092461 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.092442    2582 scope.go:117] "RemoveContainer" containerID="54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2"
Jul 31 00:41:59.092713 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:59.092694    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2\": container with ID starting with 54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2 not found: ID does not exist" containerID="54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2"
Jul 31 00:41:59.092759 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.092723    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2"} err="failed to get container status \"54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2\": rpc error: code = NotFound desc = could not find container \"54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2\": container with ID starting with 54b24c1d0946dabecc58e98082728fb5b9e00bfe22863bcb1b4b7dcf79e67ef2 not found: ID does not exist"
Jul 31 00:41:59.092759 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.092740    2582 scope.go:117] "RemoveContainer" containerID="7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d"
Jul 31 00:41:59.092992 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:41:59.092972    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d\": container with ID starting with 7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d not found: ID does not exist" containerID="7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d"
Jul 31 00:41:59.093042 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.093000    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d"} err="failed to get container status \"7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d\": rpc error: code = NotFound desc = could not find container \"7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d\": container with ID starting with 7e1ed45b69ecba9a4489c5eeae3b3cbbc06cf75214dbfbd4726806da11dabe9d not found: ID does not exist"
Jul 31 00:41:59.100952 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.100932    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"]
Jul 31 00:41:59.104448 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:41:59.104427    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eee00287-openshift-default-667dc79c96-jsr2c"]
Jul 31 00:42:00.248653 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:00.248603    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" path="/var/lib/kubelet/pods/eea78685-974d-4b44-80b9-f7326b74cca4/volumes"
Jul 31 00:42:05.085865 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:05.085834    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:42:20.947894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.945052    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"]
Jul 31 00:42:20.947894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.945903    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy"
Jul 31 00:42:20.947894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.945924    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy"
Jul 31 00:42:20.947894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.945953    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy"
Jul 31 00:42:20.947894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.945962    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy"
Jul 31 00:42:20.947894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.946133    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy"
Jul 31 00:42:20.947894 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.946157    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea78685-974d-4b44-80b9-f7326b74cca4" containerName="istio-proxy"
Jul 31 00:42:20.950549 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.950514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"
Jul 31 00:42:20.952264 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.952235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"]
Jul 31 00:42:20.953188 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:20.953163    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gpvxj\""
Jul 31 00:42:21.110987 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:21.110957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8087eb54-b6c7-4644-a7e2-6c6ec5f2c759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr\" (UID: \"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"
Jul 31 00:42:21.212099 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:21.212020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8087eb54-b6c7-4644-a7e2-6c6ec5f2c759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr\" (UID: \"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"
Jul 31 00:42:21.212601 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:21.212581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8087eb54-b6c7-4644-a7e2-6c6ec5f2c759-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr\" (UID: \"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"
Jul 31 00:42:21.262428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:21.262401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"
Jul 31 00:42:21.390960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:21.390933    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"]
Jul 31 00:42:21.392283 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:42:21.392257    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8087eb54_b6c7_4644_a7e2_6c6ec5f2c759.slice/crio-210505fdf9c7a1e5b333b3a983ef9872d03cc6a61a23d7a614ec15d54f47e2fd WatchSource:0}: Error finding container 210505fdf9c7a1e5b333b3a983ef9872d03cc6a61a23d7a614ec15d54f47e2fd: Status 404 returned error can't find the container with id 210505fdf9c7a1e5b333b3a983ef9872d03cc6a61a23d7a614ec15d54f47e2fd
Jul 31 00:42:22.202691 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:22.202652    2582 generic.go:356] "Generic (PLEG): container finished" podID="8087eb54-b6c7-4644-a7e2-6c6ec5f2c759" containerID="b89bcdb2d049cbd2aaacd4eb73ee78d2d4e8c49132a9ee907f36d34eeb796399" exitCode=0
Jul 31 00:42:22.203077 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:22.202717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr" event={"ID":"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759","Type":"ContainerDied","Data":"b89bcdb2d049cbd2aaacd4eb73ee78d2d4e8c49132a9ee907f36d34eeb796399"}
Jul 31 00:42:22.203077 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:22.202765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr" event={"ID":"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759","Type":"ContainerStarted","Data":"210505fdf9c7a1e5b333b3a983ef9872d03cc6a61a23d7a614ec15d54f47e2fd"}
Jul 31 00:42:23.336243 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:23.336221    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"
Jul 31 00:42:23.430216 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:23.430185    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8087eb54-b6c7-4644-a7e2-6c6ec5f2c759-maas-api-service-ca\") pod \"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759\" (UID: \"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759\") "
Jul 31 00:42:23.430526 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:23.430505    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8087eb54-b6c7-4644-a7e2-6c6ec5f2c759-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8087eb54-b6c7-4644-a7e2-6c6ec5f2c759" (UID: "8087eb54-b6c7-4644-a7e2-6c6ec5f2c759"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:42:23.530905 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:23.530881    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8087eb54-b6c7-4644-a7e2-6c6ec5f2c759-maas-api-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:42:24.214091 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:24.214057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr" event={"ID":"8087eb54-b6c7-4644-a7e2-6c6ec5f2c759","Type":"ContainerDied","Data":"210505fdf9c7a1e5b333b3a983ef9872d03cc6a61a23d7a614ec15d54f47e2fd"}
Jul 31 00:42:24.214256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:24.214113    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="210505fdf9c7a1e5b333b3a983ef9872d03cc6a61a23d7a614ec15d54f47e2fd"
Jul 31 00:42:24.214256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:24.214072    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"
Jul 31 00:42:27.598820 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.598783    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"]
Jul 31 00:42:27.599181 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.599028    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk" podUID="da5a901e-0552-479e-804c-a8a35a0eba69" containerName="maas-api" containerID="cri-o://39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90" gracePeriod=30
Jul 31 00:42:27.787275 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.787240    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"]
Jul 31 00:42:27.789438 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.789409    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-eeb90a6e-z7kmr"]
Jul 31 00:42:27.864166 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.864143    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:42:27.967855 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.967818    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq75m\" (UniqueName: \"kubernetes.io/projected/da5a901e-0552-479e-804c-a8a35a0eba69-kube-api-access-gq75m\") pod \"da5a901e-0552-479e-804c-a8a35a0eba69\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") "
Jul 31 00:42:27.968019 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.967859    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5a901e-0552-479e-804c-a8a35a0eba69-openshift-service-ca\") pod \"da5a901e-0552-479e-804c-a8a35a0eba69\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") "
Jul 31 00:42:27.968019 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.967899    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls\") pod \"da5a901e-0552-479e-804c-a8a35a0eba69\" (UID: \"da5a901e-0552-479e-804c-a8a35a0eba69\") "
Jul 31 00:42:27.968256 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.968229    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da5a901e-0552-479e-804c-a8a35a0eba69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da5a901e-0552-479e-804c-a8a35a0eba69" (UID: "da5a901e-0552-479e-804c-a8a35a0eba69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:42:27.970006 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.969979    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da5a901e-0552-479e-804c-a8a35a0eba69" (UID: "da5a901e-0552-479e-804c-a8a35a0eba69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:42:27.970110 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:27.970061    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5a901e-0552-479e-804c-a8a35a0eba69-kube-api-access-gq75m" (OuterVolumeSpecName: "kube-api-access-gq75m") pod "da5a901e-0552-479e-804c-a8a35a0eba69" (UID: "da5a901e-0552-479e-804c-a8a35a0eba69"). InnerVolumeSpecName "kube-api-access-gq75m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:42:28.068730 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.068670    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq75m\" (UniqueName: \"kubernetes.io/projected/da5a901e-0552-479e-804c-a8a35a0eba69-kube-api-access-gq75m\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:42:28.068730 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.068723    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5a901e-0552-479e-804c-a8a35a0eba69-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:42:28.068730 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.068733    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5a901e-0552-479e-804c-a8a35a0eba69-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:42:28.236867 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.236787    2582 generic.go:356] "Generic (PLEG): container finished" podID="da5a901e-0552-479e-804c-a8a35a0eba69" containerID="39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90" exitCode=0
Jul 31 00:42:28.236867 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.236833    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"
Jul 31 00:42:28.237035 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.236875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk" event={"ID":"da5a901e-0552-479e-804c-a8a35a0eba69","Type":"ContainerDied","Data":"39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90"}
Jul 31 00:42:28.237035 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.236931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk" event={"ID":"da5a901e-0552-479e-804c-a8a35a0eba69","Type":"ContainerDied","Data":"891112484cb60753819a2ca63615c306d9d0e2552f565434ebd52f83081bd0b7"}
Jul 31 00:42:28.237035 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.236956    2582 scope.go:117] "RemoveContainer" containerID="39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90"
Jul 31 00:42:28.249725 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.249659    2582 scope.go:117] "RemoveContainer" containerID="39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90"
Jul 31 00:42:28.249943 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:42:28.249924    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90\": container with ID starting with 39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90 not found: ID does not exist" containerID="39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90"
Jul 31 00:42:28.249997 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.249953    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90"} err="failed to get container status \"39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90\": rpc error: code = NotFound desc = could not find container \"39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90\": container with ID starting with 39e92c23bd63ac4ae01f2a76882d94729efafcd0d8130fd26fadc466125e9a90 not found: ID does not exist"
Jul 31 00:42:28.252772 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.252749    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8087eb54-b6c7-4644-a7e2-6c6ec5f2c759" path="/var/lib/kubelet/pods/8087eb54-b6c7-4644-a7e2-6c6ec5f2c759/volumes"
Jul 31 00:42:28.262511 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.262487    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"]
Jul 31 00:42:28.265886 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:28.265866    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eeb90a6e-654f845b5-km9xk"]
Jul 31 00:42:30.248086 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:42:30.248057    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da5a901e-0552-479e-804c-a8a35a0eba69" path="/var/lib/kubelet/pods/da5a901e-0552-479e-804c-a8a35a0eba69/volumes"
Jul 31 00:44:24.842181 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.842137    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"]
Jul 31 00:44:24.842694 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.842530    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da5a901e-0552-479e-804c-a8a35a0eba69" containerName="maas-api"
Jul 31 00:44:24.842694 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.842541    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da5a901e-0552-479e-804c-a8a35a0eba69" containerName="maas-api"
Jul 31 00:44:24.842694 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.842553    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8087eb54-b6c7-4644-a7e2-6c6ec5f2c759" containerName="revoke-keys"
Jul 31 00:44:24.842694 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.842559    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8087eb54-b6c7-4644-a7e2-6c6ec5f2c759" containerName="revoke-keys"
Jul 31 00:44:24.842694 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.842635    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da5a901e-0552-479e-804c-a8a35a0eba69" containerName="maas-api"
Jul 31 00:44:24.842694 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.842644    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8087eb54-b6c7-4644-a7e2-6c6ec5f2c759" containerName="revoke-keys"
Jul 31 00:44:24.845659 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.845638    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.848154 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.848134    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-632e9fcf-openshift-default-dockercfg-rh8qd\""
Jul 31 00:44:24.865122 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.865103    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"]
Jul 31 00:44:24.970871 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.970837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442adda2-008c-45e6-a87e-8a45c3ccae89-istiod-ca-cert\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.970880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-certs\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.970900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-socket\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.970915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-envoy\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.970977    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-data\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.971000    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-token\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.971017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-podinfo\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971224 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.971040    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjvp\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-kube-api-access-wvjvp\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:24.971224 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:24.971065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-credential-socket\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072317 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442adda2-008c-45e6-a87e-8a45c3ccae89-istiod-ca-cert\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-certs\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-socket\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-envoy\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072470 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-data\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-token\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-podinfo\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjvp\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-kube-api-access-wvjvp\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-credential-socket\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072910 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-certs\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.072910 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-data\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.073009 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.072942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-credential-socket\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.073074 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.073054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-socket\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.073155 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.073139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442adda2-008c-45e6-a87e-8a45c3ccae89-istiod-ca-cert\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.074719 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.074700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-envoy\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.075035 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.075013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-podinfo\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.080087 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.080061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-token\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.080200 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.080175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjvp\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-kube-api-access-wvjvp\") pod \"e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") " pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.155994 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.155929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:25.285060 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.285035    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"]
Jul 31 00:44:25.286619 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:44:25.286594    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442adda2_008c_45e6_a87e_8a45c3ccae89.slice/crio-afe4f239e91893a1828a9eb6379348ac1fb59ac0e03b3e5a4f7d14cbf2e4f341 WatchSource:0}: Error finding container afe4f239e91893a1828a9eb6379348ac1fb59ac0e03b3e5a4f7d14cbf2e4f341: Status 404 returned error can't find the container with id afe4f239e91893a1828a9eb6379348ac1fb59ac0e03b3e5a4f7d14cbf2e4f341
Jul 31 00:44:25.288906 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.288876    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:44:25.288978 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.288941    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:44:25.288978 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.288969    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:44:25.877357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.877319    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" event={"ID":"442adda2-008c-45e6-a87e-8a45c3ccae89","Type":"ContainerStarted","Data":"7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198"}
Jul 31 00:44:25.877738 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.877379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" event={"ID":"442adda2-008c-45e6-a87e-8a45c3ccae89","Type":"ContainerStarted","Data":"afe4f239e91893a1828a9eb6379348ac1fb59ac0e03b3e5a4f7d14cbf2e4f341"}
Jul 31 00:44:25.912794 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:25.912750    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podStartSLOduration=1.912735192 podStartE2EDuration="1.912735192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:44:25.910685758 +0000 UTC m=+2306.187928746" watchObservedRunningTime="2026-07-31 00:44:25.912735192 +0000 UTC m=+2306.189978180"
Jul 31 00:44:26.156293 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:26.156220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:26.161041 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:26.161020    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:26.883556 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:26.883524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:26.884562 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:26.884541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:29.004690 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.004650    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"]
Jul 31 00:44:29.008514 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.008493    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.011183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.011150    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-632e9fcf-serving-cert\""
Jul 31 00:44:29.011405 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.011385    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:44:29.017960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.017937    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"]
Jul 31 00:44:29.112176 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.112145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-maas-api-tls\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.112354 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.112195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-openshift-service-ca\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.112354 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.112222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lkv8\" (UniqueName: \"kubernetes.io/projected/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-kube-api-access-6lkv8\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.213359 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.213327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-maas-api-tls\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.213519 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.213372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-openshift-service-ca\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.213519 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.213389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lkv8\" (UniqueName: \"kubernetes.io/projected/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-kube-api-access-6lkv8\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.213992 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.213964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-openshift-service-ca\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.215749 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.215732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-maas-api-tls\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.221531 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.221504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lkv8\" (UniqueName: \"kubernetes.io/projected/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-kube-api-access-6lkv8\") pod \"maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.321422 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.321367    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:29.453347 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.453306    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"]
Jul 31 00:44:29.454380 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:44:29.454355    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3ac226_5567_44f1_8c4f_914f14f6d9b8.slice/crio-a6b66afd2b6a14e5e9d04e95c50630d83de8bc8f161b0408cbc3245d047966f9 WatchSource:0}: Error finding container a6b66afd2b6a14e5e9d04e95c50630d83de8bc8f161b0408cbc3245d047966f9: Status 404 returned error can't find the container with id a6b66afd2b6a14e5e9d04e95c50630d83de8bc8f161b0408cbc3245d047966f9
Jul 31 00:44:29.901647 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:29.901608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd" event={"ID":"bc3ac226-5567-44f1-8c4f-914f14f6d9b8","Type":"ContainerStarted","Data":"a6b66afd2b6a14e5e9d04e95c50630d83de8bc8f161b0408cbc3245d047966f9"}
Jul 31 00:44:30.908027 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:30.907995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd" event={"ID":"bc3ac226-5567-44f1-8c4f-914f14f6d9b8","Type":"ContainerStarted","Data":"d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26"}
Jul 31 00:44:30.908571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:30.908078    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:30.924344 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:30.924300    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd" podStartSLOduration=2.53571186 podStartE2EDuration="2.924288538s" totalImagesPullingTime="388.576678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:44:30.922250983 +0000 UTC m=+2311.199493973" watchObservedRunningTime="2026-07-31 00:44:30.924288538 +0000 UTC m=+2311.201531555"
Jul 31 00:44:36.919928 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:36.919899    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:44:41.884527 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.884486    2582 patch_prober.go:28] interesting pod/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 31 00:44:41.885015 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.884559    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 31 00:44:41.986575 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.986545    2582 generic.go:356] "Generic (PLEG): container finished" podID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerID="7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198" exitCode=0
Jul 31 00:44:41.986763 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.986597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" event={"ID":"442adda2-008c-45e6-a87e-8a45c3ccae89","Type":"ContainerDied","Data":"7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198"}
Jul 31 00:44:41.986968 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.986953    2582 scope.go:117] "RemoveContainer" containerID="7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198"
Jul 31 00:44:41.987919 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.987892    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:44:41.987970 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.987961    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:44:41.988005 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:41.987996    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:44:42.993706 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:42.993662    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" event={"ID":"442adda2-008c-45e6-a87e-8a45c3ccae89","Type":"ContainerStarted","Data":"9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305"}
Jul 31 00:44:43.156683 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:43.156648    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:43.156876 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:43.156858    2582 patch_prober.go:28] interesting pod/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 31 00:44:43.156921 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:43.156899    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 31 00:44:44.156378 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:44.156341    2582 patch_prober.go:28] interesting pod/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 31 00:44:44.156858 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:44.156396    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 31 00:44:45.156392 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:45.156359    2582 patch_prober.go:28] interesting pod/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 31 00:44:45.156797 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:45.156415    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 31 00:44:46.156563 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:46.156528    2582 patch_prober.go:28] interesting pod/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 31 00:44:46.156971 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:46.156585    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 31 00:44:47.157113 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:47.157079    2582 patch_prober.go:28] interesting pod/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 31 00:44:47.157508 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:47.157134    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 31 00:44:48.161147 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:48.161109    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:48.161548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:48.161447    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:44:48.161967 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:44:48.161950    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:45:30.690424 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:30.690388    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"]
Jul 31 00:45:30.691065 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:30.690681    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd" podUID="bc3ac226-5567-44f1-8c4f-914f14f6d9b8" containerName="maas-api" containerID="cri-o://d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26" gracePeriod=30
Jul 31 00:45:30.947868 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:30.947808    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:45:31.077891 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.077858    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-maas-api-tls\") pod \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") "
Jul 31 00:45:31.078070 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.077931    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lkv8\" (UniqueName: \"kubernetes.io/projected/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-kube-api-access-6lkv8\") pod \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") "
Jul 31 00:45:31.078070 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.077984    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-openshift-service-ca\") pod \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\" (UID: \"bc3ac226-5567-44f1-8c4f-914f14f6d9b8\") "
Jul 31 00:45:31.078357 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.078329    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc3ac226-5567-44f1-8c4f-914f14f6d9b8" (UID: "bc3ac226-5567-44f1-8c4f-914f14f6d9b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:45:31.079953 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.079927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc3ac226-5567-44f1-8c4f-914f14f6d9b8" (UID: "bc3ac226-5567-44f1-8c4f-914f14f6d9b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:45:31.080052 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.079998    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-kube-api-access-6lkv8" (OuterVolumeSpecName: "kube-api-access-6lkv8") pod "bc3ac226-5567-44f1-8c4f-914f14f6d9b8" (UID: "bc3ac226-5567-44f1-8c4f-914f14f6d9b8"). InnerVolumeSpecName "kube-api-access-6lkv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:45:31.178556 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.178529    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lkv8\" (UniqueName: \"kubernetes.io/projected/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-kube-api-access-6lkv8\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:31.178556 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.178552    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:31.178556 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.178562    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc3ac226-5567-44f1-8c4f-914f14f6d9b8-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:31.267129 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.267096    2582 generic.go:356] "Generic (PLEG): container finished" podID="bc3ac226-5567-44f1-8c4f-914f14f6d9b8" containerID="d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26" exitCode=0
Jul 31 00:45:31.267298 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.267144    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"
Jul 31 00:45:31.267298 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.267185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd" event={"ID":"bc3ac226-5567-44f1-8c4f-914f14f6d9b8","Type":"ContainerDied","Data":"d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26"}
Jul 31 00:45:31.267298 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.267249    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd" event={"ID":"bc3ac226-5567-44f1-8c4f-914f14f6d9b8","Type":"ContainerDied","Data":"a6b66afd2b6a14e5e9d04e95c50630d83de8bc8f161b0408cbc3245d047966f9"}
Jul 31 00:45:31.267298 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.267280    2582 scope.go:117] "RemoveContainer" containerID="d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26"
Jul 31 00:45:31.276717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.276698    2582 scope.go:117] "RemoveContainer" containerID="d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26"
Jul 31 00:45:31.276967 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:45:31.276933    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26\": container with ID starting with d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26 not found: ID does not exist" containerID="d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26"
Jul 31 00:45:31.277007 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.276979    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26"} err="failed to get container status \"d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26\": rpc error: code = NotFound desc = could not find container \"d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26\": container with ID starting with d2200d8301fda75444484d451841a6f0264c910f9fbae69003e99529ac747f26 not found: ID does not exist"
Jul 31 00:45:31.288656 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.288631    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"]
Jul 31 00:45:31.292562 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:31.292543    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-632e9fcf-c9c68975d-64tgd"]
Jul 31 00:45:32.251306 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:32.251272    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3ac226-5567-44f1-8c4f-914f14f6d9b8" path="/var/lib/kubelet/pods/bc3ac226-5567-44f1-8c4f-914f14f6d9b8/volumes"
Jul 31 00:45:37.445029 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:37.444993    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"]
Jul 31 00:45:37.445409 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:37.445270    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy" containerID="cri-o://9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305" gracePeriod=30
Jul 31 00:45:42.694926 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.694898    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:45:42.886061 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886027    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-data\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886240 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886071    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-certs\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886240 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-credential-socket\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886240 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886133    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442adda2-008c-45e6-a87e-8a45c3ccae89-istiod-ca-cert\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886240 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886178    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvjvp\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-kube-api-access-wvjvp\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886240 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-token\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886240 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886214    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-podinfo\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886534 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886246    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-envoy\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886534 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886315    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-socket\") pod \"442adda2-008c-45e6-a87e-8a45c3ccae89\" (UID: \"442adda2-008c-45e6-a87e-8a45c3ccae89\") "
Jul 31 00:45:42.886534 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886359    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-data" (OuterVolumeSpecName: "istio-data") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:45:42.886534 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886390    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:45:42.886534 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886487    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:45:42.886838 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886582    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:45:42.886838 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886708    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/442adda2-008c-45e6-a87e-8a45c3ccae89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:45:42.886838 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886734    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.886838 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886755    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.886838 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886768    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.886838 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.886782    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.888520 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.888492    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-token" (OuterVolumeSpecName: "istio-token") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:45:42.888656 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.888616    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:45:42.888725 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.888663    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 00:45:42.888725 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.888657    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-kube-api-access-wvjvp" (OuterVolumeSpecName: "kube-api-access-wvjvp") pod "442adda2-008c-45e6-a87e-8a45c3ccae89" (UID: "442adda2-008c-45e6-a87e-8a45c3ccae89"). InnerVolumeSpecName "kube-api-access-wvjvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:45:42.987242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.987201    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442adda2-008c-45e6-a87e-8a45c3ccae89-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.987242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.987235    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvjvp\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-kube-api-access-wvjvp\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.987242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.987248    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.987473 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.987259    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:42.987473 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:42.987267    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442adda2-008c-45e6-a87e-8a45c3ccae89-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:45:43.335060 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.335022    2582 generic.go:356] "Generic (PLEG): container finished" podID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerID="9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305" exitCode=0
Jul 31 00:45:43.335266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.335077    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"
Jul 31 00:45:43.335266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.335105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" event={"ID":"442adda2-008c-45e6-a87e-8a45c3ccae89","Type":"ContainerDied","Data":"9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305"}
Jul 31 00:45:43.335266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.335157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p" event={"ID":"442adda2-008c-45e6-a87e-8a45c3ccae89","Type":"ContainerDied","Data":"afe4f239e91893a1828a9eb6379348ac1fb59ac0e03b3e5a4f7d14cbf2e4f341"}
Jul 31 00:45:43.335266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.335179    2582 scope.go:117] "RemoveContainer" containerID="9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305"
Jul 31 00:45:43.344692 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.344669    2582 scope.go:117] "RemoveContainer" containerID="7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198"
Jul 31 00:45:43.353054 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.353037    2582 scope.go:117] "RemoveContainer" containerID="9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305"
Jul 31 00:45:43.353317 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:45:43.353298    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305\": container with ID starting with 9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305 not found: ID does not exist" containerID="9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305"
Jul 31 00:45:43.353369 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.353326    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305"} err="failed to get container status \"9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305\": rpc error: code = NotFound desc = could not find container \"9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305\": container with ID starting with 9153bafbc65bc119a221d9f97fd8ebcbfef462680a9de53ccd21696a4fbb9305 not found: ID does not exist"
Jul 31 00:45:43.353369 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.353343    2582 scope.go:117] "RemoveContainer" containerID="7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198"
Jul 31 00:45:43.353540 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:45:43.353524    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198\": container with ID starting with 7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198 not found: ID does not exist" containerID="7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198"
Jul 31 00:45:43.353582 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.353544    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198"} err="failed to get container status \"7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198\": rpc error: code = NotFound desc = could not find container \"7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198\": container with ID starting with 7fe5105d2844c02fe9bb7ebd94cff72aa6312aeac052482faab8779e124e8198 not found: ID does not exist"
Jul 31 00:45:43.357262 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.357232    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"]
Jul 31 00:45:43.360612 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:43.360592    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-632e9fcf-openshift-default-7df45987c6-khz5p"]
Jul 31 00:45:44.249154 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:45:44.249124    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" path="/var/lib/kubelet/pods/442adda2-008c-45e6-a87e-8a45c3ccae89/volumes"
Jul 31 00:46:00.430335 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:46:00.430311    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:46:00.437527 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:46:00.437504    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:46:00.437662 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:46:00.437510    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:46:00.444680 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:46:00.444661    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:47:52.256723 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.256643    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"]
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257046    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy"
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257059    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy"
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257069    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy"
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257075    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy"
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257082    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3ac226-5567-44f1-8c4f-914f14f6d9b8" containerName="maas-api"
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257087    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3ac226-5567-44f1-8c4f-914f14f6d9b8" containerName="maas-api"
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257141    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy"
Jul 31 00:47:52.257225 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.257151    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3ac226-5567-44f1-8c4f-914f14f6d9b8" containerName="maas-api"
Jul 31 00:47:52.260344 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.260327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.262968 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.262945    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3f92bdba-openshift-default-dockercfg-kf2rb\""
Jul 31 00:47:52.279312 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.279264    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"]
Jul 31 00:47:52.352748 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-credential-socket\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.352748 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-data\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.352977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2147960c-0167-4c90-9238-ec9c6c5f5217-istiod-ca-cert\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.352977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-socket\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.352977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-envoy\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.352977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-podinfo\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.352977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-token\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.352977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-certs\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.353286 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.352983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d56fr\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-kube-api-access-d56fr\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.453862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.453823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-credential-socket\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.453862 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.453861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-data\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.453883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2147960c-0167-4c90-9238-ec9c6c5f5217-istiod-ca-cert\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.453907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-socket\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.453924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-envoy\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.453953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-podinfo\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.453986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-token\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.454023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-certs\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454098 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.454067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d56fr\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-kube-api-access-d56fr\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454454 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.454294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-credential-socket\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454454 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.454333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-data\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454566 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.454532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-certs\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454566 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.454530    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-socket\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.454753 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.454724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2147960c-0167-4c90-9238-ec9c6c5f5217-istiod-ca-cert\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.456359 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.456335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-envoy\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.456561 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.456545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-podinfo\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.461719 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.461700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-token\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.461926 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.461904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d56fr\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-kube-api-access-d56fr\") pod \"e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") " pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.572340 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.572273    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:52.706081 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.706056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"]
Jul 31 00:47:52.707210 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:47:52.707183    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2147960c_0167_4c90_9238_ec9c6c5f5217.slice/crio-dbd7d4f1cb1ee0debda6e513d9a0097a832b606133c5fceca20dad7d2ed7fede WatchSource:0}: Error finding container dbd7d4f1cb1ee0debda6e513d9a0097a832b606133c5fceca20dad7d2ed7fede: Status 404 returned error can't find the container with id dbd7d4f1cb1ee0debda6e513d9a0097a832b606133c5fceca20dad7d2ed7fede
Jul 31 00:47:52.709415 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.709381    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:47:52.709508 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.709460    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:47:52.709574 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:52.709504    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:47:53.069221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:53.069180    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" event={"ID":"2147960c-0167-4c90-9238-ec9c6c5f5217","Type":"ContainerStarted","Data":"4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5"}
Jul 31 00:47:53.069403 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:53.069230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" event={"ID":"2147960c-0167-4c90-9238-ec9c6c5f5217","Type":"ContainerStarted","Data":"dbd7d4f1cb1ee0debda6e513d9a0097a832b606133c5fceca20dad7d2ed7fede"}
Jul 31 00:47:53.088764 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:53.088710    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podStartSLOduration=1.088694683 podStartE2EDuration="1.088694683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:47:53.085957629 +0000 UTC m=+2513.363200629" watchObservedRunningTime="2026-07-31 00:47:53.088694683 +0000 UTC m=+2513.365937671"
Jul 31 00:47:53.573416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:53.573378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:53.578360 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:53.578332    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:54.074265 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:54.074235    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:54.075142 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:54.075126    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:47:56.107767 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.107733    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"]
Jul 31 00:47:56.108181 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.108167    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="442adda2-008c-45e6-a87e-8a45c3ccae89" containerName="istio-proxy"
Jul 31 00:47:56.111514 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.111491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.113979 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.113948    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3f92bdba-serving-cert\""
Jul 31 00:47:56.114102 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.114010    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:47:56.121359 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.121339    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"]
Jul 31 00:47:56.289977 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.289941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6669da86-5eef-4f1b-ae34-e2114dcb3d51-maas-api-tls\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.290144 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.289989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psxmp\" (UniqueName: \"kubernetes.io/projected/6669da86-5eef-4f1b-ae34-e2114dcb3d51-kube-api-access-psxmp\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.290144 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.290009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6669da86-5eef-4f1b-ae34-e2114dcb3d51-openshift-service-ca\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.390743 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.390674    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6669da86-5eef-4f1b-ae34-e2114dcb3d51-maas-api-tls\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.390743 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.390734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psxmp\" (UniqueName: \"kubernetes.io/projected/6669da86-5eef-4f1b-ae34-e2114dcb3d51-kube-api-access-psxmp\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.390941 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.390759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6669da86-5eef-4f1b-ae34-e2114dcb3d51-openshift-service-ca\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.391450 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.391433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6669da86-5eef-4f1b-ae34-e2114dcb3d51-openshift-service-ca\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.393196 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.393178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6669da86-5eef-4f1b-ae34-e2114dcb3d51-maas-api-tls\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.406895 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.406877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psxmp\" (UniqueName: \"kubernetes.io/projected/6669da86-5eef-4f1b-ae34-e2114dcb3d51-kube-api-access-psxmp\") pod \"maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.423727 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.423705    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:56.762004 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.761974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"]
Jul 31 00:47:56.764815 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:47:56.764762    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6669da86_5eef_4f1b_ae34_e2114dcb3d51.slice/crio-e1a12a1bdbecc98616668a2c26d04815d42e758102f05dd0137cd5b49bbcd403 WatchSource:0}: Error finding container e1a12a1bdbecc98616668a2c26d04815d42e758102f05dd0137cd5b49bbcd403: Status 404 returned error can't find the container with id e1a12a1bdbecc98616668a2c26d04815d42e758102f05dd0137cd5b49bbcd403
Jul 31 00:47:56.766516 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:56.766499    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:47:57.094226 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:57.094141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc" event={"ID":"6669da86-5eef-4f1b-ae34-e2114dcb3d51","Type":"ContainerStarted","Data":"e1a12a1bdbecc98616668a2c26d04815d42e758102f05dd0137cd5b49bbcd403"}
Jul 31 00:47:58.101932 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:58.101888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc" event={"ID":"6669da86-5eef-4f1b-ae34-e2114dcb3d51","Type":"ContainerStarted","Data":"a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e"}
Jul 31 00:47:58.102378 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:58.102039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:47:58.120798 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:47:58.120757    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc" podStartSLOduration=1.4072516290000001 podStartE2EDuration="2.120743493s" totalImagesPullingTime="713.491864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:47:58.117878949 +0000 UTC m=+2518.395121939" watchObservedRunningTime="2026-07-31 00:47:58.120743493 +0000 UTC m=+2518.397986493"
Jul 31 00:48:00.553105 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:00.553073    2582 scope.go:117] "RemoveContainer" containerID="25c0476cadee31aee094275a19375379bfe2b8e922030054eb22831c18e8ac7b"
Jul 31 00:48:04.113675 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:04.113644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:48:10.115752 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:10.115716    2582 patch_prober.go:28] interesting pod/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 00:48:10.116188 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:10.115773    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 00:48:11.185720 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:11.185680    2582 generic.go:356] "Generic (PLEG): container finished" podID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerID="4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5" exitCode=0
Jul 31 00:48:11.186233 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:11.185758    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" event={"ID":"2147960c-0167-4c90-9238-ec9c6c5f5217","Type":"ContainerDied","Data":"4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5"}
Jul 31 00:48:11.186306 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:11.186233    2582 scope.go:117] "RemoveContainer" containerID="4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5"
Jul 31 00:48:11.187250 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:11.187224    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:48:11.187353 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:11.187305    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:48:11.187415 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:11.187352    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:48:12.193051 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:12.193014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" event={"ID":"2147960c-0167-4c90-9238-ec9c6c5f5217","Type":"ContainerStarted","Data":"f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff"}
Jul 31 00:48:12.573345 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:12.573314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:48:12.573524 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:12.573483    2582 patch_prober.go:28] interesting pod/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 31 00:48:12.573571 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:12.573535    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 31 00:48:13.572943 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:13.572904    2582 patch_prober.go:28] interesting pod/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 31 00:48:13.573435 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:13.572965    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 31 00:48:14.573609 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:14.573580    2582 patch_prober.go:28] interesting pod/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 31 00:48:14.574032 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:14.573693    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 31 00:48:15.573596 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:15.573360    2582 patch_prober.go:28] interesting pod/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 31 00:48:15.573827 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:15.573649    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 31 00:48:16.573227 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:16.573192    2582 patch_prober.go:28] interesting pod/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 31 00:48:16.573435 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:16.573264    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 31 00:48:17.576650 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:17.576607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:48:17.577026 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:17.576915    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:48:17.577418 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:48:17.577399    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:49:00.572842 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:00.572812    2582 scope.go:117] "RemoveContainer" containerID="b89bcdb2d049cbd2aaacd4eb73ee78d2d4e8c49132a9ee907f36d34eeb796399"
Jul 31 00:49:10.014854 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.014821    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"]
Jul 31 00:49:10.015317 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.015091    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc" podUID="6669da86-5eef-4f1b-ae34-e2114dcb3d51" containerName="maas-api" containerID="cri-o://a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e" gracePeriod=30
Jul 31 00:49:10.267967 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.267895    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:49:10.350739 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.350690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6669da86-5eef-4f1b-ae34-e2114dcb3d51-openshift-service-ca\") pod \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") "
Jul 31 00:49:10.350739 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.350737    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psxmp\" (UniqueName: \"kubernetes.io/projected/6669da86-5eef-4f1b-ae34-e2114dcb3d51-kube-api-access-psxmp\") pod \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") "
Jul 31 00:49:10.350986 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.350765    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6669da86-5eef-4f1b-ae34-e2114dcb3d51-maas-api-tls\") pod \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\" (UID: \"6669da86-5eef-4f1b-ae34-e2114dcb3d51\") "
Jul 31 00:49:10.351121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.351089    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6669da86-5eef-4f1b-ae34-e2114dcb3d51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6669da86-5eef-4f1b-ae34-e2114dcb3d51" (UID: "6669da86-5eef-4f1b-ae34-e2114dcb3d51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:49:10.352957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.352932    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6669da86-5eef-4f1b-ae34-e2114dcb3d51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6669da86-5eef-4f1b-ae34-e2114dcb3d51" (UID: "6669da86-5eef-4f1b-ae34-e2114dcb3d51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:49:10.353402 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.353374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6669da86-5eef-4f1b-ae34-e2114dcb3d51-kube-api-access-psxmp" (OuterVolumeSpecName: "kube-api-access-psxmp") pod "6669da86-5eef-4f1b-ae34-e2114dcb3d51" (UID: "6669da86-5eef-4f1b-ae34-e2114dcb3d51"). InnerVolumeSpecName "kube-api-access-psxmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:49:10.451663 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.451616    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6669da86-5eef-4f1b-ae34-e2114dcb3d51-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:49:10.451663 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.451659    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psxmp\" (UniqueName: \"kubernetes.io/projected/6669da86-5eef-4f1b-ae34-e2114dcb3d51-kube-api-access-psxmp\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:49:10.451663 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.451668    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6669da86-5eef-4f1b-ae34-e2114dcb3d51-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:49:10.513962 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.513929    2582 generic.go:356] "Generic (PLEG): container finished" podID="6669da86-5eef-4f1b-ae34-e2114dcb3d51" containerID="a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e" exitCode=0
Jul 31 00:49:10.514082 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.513982    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"
Jul 31 00:49:10.514082 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.514011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc" event={"ID":"6669da86-5eef-4f1b-ae34-e2114dcb3d51","Type":"ContainerDied","Data":"a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e"}
Jul 31 00:49:10.514082 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.514061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc" event={"ID":"6669da86-5eef-4f1b-ae34-e2114dcb3d51","Type":"ContainerDied","Data":"e1a12a1bdbecc98616668a2c26d04815d42e758102f05dd0137cd5b49bbcd403"}
Jul 31 00:49:10.514188 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.514084    2582 scope.go:117] "RemoveContainer" containerID="a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e"
Jul 31 00:49:10.523286 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.523271    2582 scope.go:117] "RemoveContainer" containerID="a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e"
Jul 31 00:49:10.523529 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:49:10.523512    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e\": container with ID starting with a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e not found: ID does not exist" containerID="a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e"
Jul 31 00:49:10.523602 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.523538    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e"} err="failed to get container status \"a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e\": rpc error: code = NotFound desc = could not find container \"a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e\": container with ID starting with a04cdf314267c2d8657f1f6df399cd91e0811644e7e55c845114fc4aa93af07e not found: ID does not exist"
Jul 31 00:49:10.538514 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.538488    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"]
Jul 31 00:49:10.540717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:10.540700    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3f92bdba-5b5ddd454c-cvllc"]
Jul 31 00:49:12.248521 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:49:12.248489    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6669da86-5eef-4f1b-ae34-e2114dcb3d51" path="/var/lib/kubelet/pods/6669da86-5eef-4f1b-ae34-e2114dcb3d51/volumes"
Jul 31 00:50:32.380428 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:32.380391    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"]
Jul 31 00:50:32.381176 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:32.380678    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" containerID="cri-o://f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff" gracePeriod=30
Jul 31 00:50:32.579194 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:32.579154    2582 patch_prober.go:28] interesting pod/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 00:50:32.579362 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:32.579232    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 00:50:37.632091 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.632067    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:50:37.715110 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715034    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-token\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715110 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715071    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-credential-socket\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715110 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-envoy\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715116    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-certs\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715155    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d56fr\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-kube-api-access-d56fr\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715189    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-podinfo\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715222    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-data\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715255    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-socket\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715307    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2147960c-0167-4c90-9238-ec9c6c5f5217-istiod-ca-cert\") pod \"2147960c-0167-4c90-9238-ec9c6c5f5217\" (UID: \"2147960c-0167-4c90-9238-ec9c6c5f5217\") "
Jul 31 00:50:37.715385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715354    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:50:37.715751 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715484    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:50:37.715751 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715587    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:50:37.715751 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715700    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.715751 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715723    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.715751 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715715    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-data" (OuterVolumeSpecName: "istio-data") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:50:37.715751 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715737    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.715988 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.715801    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2147960c-0167-4c90-9238-ec9c6c5f5217-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:50:37.717398 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.717377    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-kube-api-access-d56fr" (OuterVolumeSpecName: "kube-api-access-d56fr") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "kube-api-access-d56fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:50:37.717487 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.717472    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 00:50:37.717734 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.717715    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-token" (OuterVolumeSpecName: "istio-token") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:50:37.717796 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.717774    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2147960c-0167-4c90-9238-ec9c6c5f5217" (UID: "2147960c-0167-4c90-9238-ec9c6c5f5217"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:50:37.816548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.816499    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2147960c-0167-4c90-9238-ec9c6c5f5217-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.816548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.816542    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.816548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.816551    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.816548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.816560    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d56fr\" (UniqueName: \"kubernetes.io/projected/2147960c-0167-4c90-9238-ec9c6c5f5217-kube-api-access-d56fr\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.816548 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.816569    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.816870 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.816577    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2147960c-0167-4c90-9238-ec9c6c5f5217-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:50:37.982381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.982288    2582 generic.go:356] "Generic (PLEG): container finished" podID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerID="f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff" exitCode=0
Jul 31 00:50:37.982381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.982346    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" event={"ID":"2147960c-0167-4c90-9238-ec9c6c5f5217","Type":"ContainerDied","Data":"f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff"}
Jul 31 00:50:37.982381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.982349    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"
Jul 31 00:50:37.982667 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.982391    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc" event={"ID":"2147960c-0167-4c90-9238-ec9c6c5f5217","Type":"ContainerDied","Data":"dbd7d4f1cb1ee0debda6e513d9a0097a832b606133c5fceca20dad7d2ed7fede"}
Jul 31 00:50:37.982667 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.982412    2582 scope.go:117] "RemoveContainer" containerID="f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff"
Jul 31 00:50:37.991572 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.991555    2582 scope.go:117] "RemoveContainer" containerID="4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5"
Jul 31 00:50:37.999810 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:37.999793    2582 scope.go:117] "RemoveContainer" containerID="f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff"
Jul 31 00:50:38.000078 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:50:38.000059    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff\": container with ID starting with f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff not found: ID does not exist" containerID="f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff"
Jul 31 00:50:38.000129 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:38.000087    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff"} err="failed to get container status \"f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff\": rpc error: code = NotFound desc = could not find container \"f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff\": container with ID starting with f2503357f9577193a87c0ab6d74d6e6f9a8b0d8614d8a9972fe8c7827aebc4ff not found: ID does not exist"
Jul 31 00:50:38.000129 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:38.000105    2582 scope.go:117] "RemoveContainer" containerID="4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5"
Jul 31 00:50:38.000419 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:50:38.000401    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5\": container with ID starting with 4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5 not found: ID does not exist" containerID="4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5"
Jul 31 00:50:38.000471 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:38.000425    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5"} err="failed to get container status \"4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5\": rpc error: code = NotFound desc = could not find container \"4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5\": container with ID starting with 4f9b072a97c08d4babe93afee08272e18d2a49ddeef1043466130904d1cac5b5 not found: ID does not exist"
Jul 31 00:50:38.003792 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:38.003771    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"]
Jul 31 00:50:38.007305 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:38.007283    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3f92bdba-openshift-default-68d9468c44-9b5cc"]
Jul 31 00:50:38.247581 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:50:38.247507    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" path="/var/lib/kubelet/pods/2147960c-0167-4c90-9238-ec9c6c5f5217/volumes"
Jul 31 00:51:00.464936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:00.464909    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:51:00.472877 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:00.472855    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:51:00.474799 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:00.474782    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:51:00.481530 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:00.481511    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:51:37.530498 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530465    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"]
Jul 31 00:51:37.530972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530872    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy"
Jul 31 00:51:37.530972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530885    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy"
Jul 31 00:51:37.530972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530898    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy"
Jul 31 00:51:37.530972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530904    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy"
Jul 31 00:51:37.530972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530923    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6669da86-5eef-4f1b-ae34-e2114dcb3d51" containerName="maas-api"
Jul 31 00:51:37.530972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530930    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6669da86-5eef-4f1b-ae34-e2114dcb3d51" containerName="maas-api"
Jul 31 00:51:37.531163 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530982    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy"
Jul 31 00:51:37.531163 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.530992    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6669da86-5eef-4f1b-ae34-e2114dcb3d51" containerName="maas-api"
Jul 31 00:51:37.534075 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.534056    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.536706 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.536682    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c23a2c-openshift-default-dockercfg-v6sv9\""
Jul 31 00:51:37.545339 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.545317    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"]
Jul 31 00:51:37.634025 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.633980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-socket\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-podinfo\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksbfw\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-kube-api-access-ksbfw\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-envoy\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-data\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634242 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e8a8807-5e17-44bf-9942-23169e2dc55a-istiod-ca-cert\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634437 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-credential-socket\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634437 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-token\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.634437 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.634281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-certs\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735373 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-data\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735373 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e8a8807-5e17-44bf-9942-23169e2dc55a-istiod-ca-cert\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735617 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-credential-socket\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735617 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-token\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735617 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-certs\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735617 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-socket\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735617 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-podinfo\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735927 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbfw\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-kube-api-access-ksbfw\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735927 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-envoy\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735927 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-data\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735927 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-credential-socket\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.735927 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.735901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-certs\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.736159 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.736056    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-socket\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.736237 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.736212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e8a8807-5e17-44bf-9942-23169e2dc55a-istiod-ca-cert\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.737975 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.737951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-envoy\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.738162 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.738143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-podinfo\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.742813 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.742792    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbfw\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-kube-api-access-ksbfw\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.742905 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.742886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-token\") pod \"e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") " pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.846423 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.846355    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:37.981882 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.981854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"]
Jul 31 00:51:37.982209 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:51:37.982188    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8a8807_5e17_44bf_9942_23169e2dc55a.slice/crio-a56a2c14c910752bd8174092c24603e11aee67361d35b8fb36c47a9a598e4f6b WatchSource:0}: Error finding container a56a2c14c910752bd8174092c24603e11aee67361d35b8fb36c47a9a598e4f6b: Status 404 returned error can't find the container with id a56a2c14c910752bd8174092c24603e11aee67361d35b8fb36c47a9a598e4f6b
Jul 31 00:51:37.984349 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.984319    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:51:37.984456 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.984387    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:51:37.984456 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:37.984437    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:51:38.300203 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:38.300167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" event={"ID":"1e8a8807-5e17-44bf-9942-23169e2dc55a","Type":"ContainerStarted","Data":"47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772"}
Jul 31 00:51:38.300385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:38.300228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" event={"ID":"1e8a8807-5e17-44bf-9942-23169e2dc55a","Type":"ContainerStarted","Data":"a56a2c14c910752bd8174092c24603e11aee67361d35b8fb36c47a9a598e4f6b"}
Jul 31 00:51:38.319745 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:38.319694    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" podStartSLOduration=1.3196811560000001 podStartE2EDuration="1.319681156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:51:38.316904891 +0000 UTC m=+2738.594147880" watchObservedRunningTime="2026-07-31 00:51:38.319681156 +0000 UTC m=+2738.596924204"
Jul 31 00:51:38.846933 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:38.846894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:39.851769 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:39.851739    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:40.310208 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:40.310181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:40.311060 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:40.311042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:41.366910 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.366878    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"]
Jul 31 00:51:41.367317 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.367302    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2147960c-0167-4c90-9238-ec9c6c5f5217" containerName="istio-proxy"
Jul 31 00:51:41.370384 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.370361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.372904 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.372882    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c23a2c-serving-cert\""
Jul 31 00:51:41.373026 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.372920    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:51:41.381244 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.381221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"]
Jul 31 00:51:41.469955 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.469928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74219895-4f24-4973-adaa-2bfd26939ad9-maas-api-tls\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.470090 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.469989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8fgq\" (UniqueName: \"kubernetes.io/projected/74219895-4f24-4973-adaa-2bfd26939ad9-kube-api-access-h8fgq\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.470090 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.470018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74219895-4f24-4973-adaa-2bfd26939ad9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.571008 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.570973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8fgq\" (UniqueName: \"kubernetes.io/projected/74219895-4f24-4973-adaa-2bfd26939ad9-kube-api-access-h8fgq\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.571191 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.571014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74219895-4f24-4973-adaa-2bfd26939ad9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.571191 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.571059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74219895-4f24-4973-adaa-2bfd26939ad9-maas-api-tls\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.571681 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.571657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74219895-4f24-4973-adaa-2bfd26939ad9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.573445 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.573423    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74219895-4f24-4973-adaa-2bfd26939ad9-maas-api-tls\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.578954 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.578925    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8fgq\" (UniqueName: \"kubernetes.io/projected/74219895-4f24-4973-adaa-2bfd26939ad9-kube-api-access-h8fgq\") pod \"maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.682180 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.682109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:41.814312 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:41.814284    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"]
Jul 31 00:51:41.815405 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:51:41.815379    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74219895_4f24_4973_adaa_2bfd26939ad9.slice/crio-b13f7619e2dea3cda7f58534d18a782613421f864afccf7ac780f16e6aa7f939 WatchSource:0}: Error finding container b13f7619e2dea3cda7f58534d18a782613421f864afccf7ac780f16e6aa7f939: Status 404 returned error can't find the container with id b13f7619e2dea3cda7f58534d18a782613421f864afccf7ac780f16e6aa7f939
Jul 31 00:51:42.321385 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:42.321353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2" event={"ID":"74219895-4f24-4973-adaa-2bfd26939ad9","Type":"ContainerStarted","Data":"b13f7619e2dea3cda7f58534d18a782613421f864afccf7ac780f16e6aa7f939"}
Jul 31 00:51:43.328442 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:43.328405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2" event={"ID":"74219895-4f24-4973-adaa-2bfd26939ad9","Type":"ContainerStarted","Data":"3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f"}
Jul 31 00:51:43.328893 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:43.328472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:43.345484 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:43.345437    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2" podStartSLOduration=1.653060116 podStartE2EDuration="2.345423343s" totalImagesPullingTime="692.363227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:51:43.344504517 +0000 UTC m=+2743.621747509" watchObservedRunningTime="2026-07-31 00:51:43.345423343 +0000 UTC m=+2743.622666332"
Jul 31 00:51:49.350755 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:49.350724    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:51:53.389178 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:53.389076    2582 generic.go:356] "Generic (PLEG): container finished" podID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerID="47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772" exitCode=0
Jul 31 00:51:53.389178 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:53.389141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" event={"ID":"1e8a8807-5e17-44bf-9942-23169e2dc55a","Type":"ContainerDied","Data":"47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772"}
Jul 31 00:51:53.389709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:53.389677    2582 scope.go:117] "RemoveContainer" containerID="47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772"
Jul 31 00:51:53.390887 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:53.390856    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:51:53.391006 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:53.390944    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:51:53.391006 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:53.390982    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:51:54.397215 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:54.397185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" event={"ID":"1e8a8807-5e17-44bf-9942-23169e2dc55a","Type":"ContainerStarted","Data":"c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c"}
Jul 31 00:51:54.847736 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:54.847698    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:54.848124 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:54.848096    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 31 00:51:54.848197 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:54.848155    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 31 00:51:55.310783 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:55.310750    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:55.846987 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:55.846953    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 31 00:51:55.847560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:55.847525    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 31 00:51:56.847594 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:56.847556    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 31 00:51:56.848056 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:56.847708    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 31 00:51:57.846974 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:57.846937    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 31 00:51:57.847267 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:57.847237    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 31 00:51:58.847129 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:58.847090    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 31 00:51:58.847726 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:58.847691    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 31 00:51:59.850775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:59.850745    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:51:59.851746 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:51:59.851727    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:52:09.827836 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:09.827802    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"]
Jul 31 00:52:09.831658 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:09.831606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:09.834223 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:09.834200    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-0fc38b-serving-cert\""
Jul 31 00:52:09.840807 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:09.840784    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"]
Jul 31 00:52:09.931708 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:09.931657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994eaf89-590e-4119-8559-f9a63b2ba713-maas-api-tls\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:09.931943 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:09.931777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4k4r\" (UniqueName: \"kubernetes.io/projected/994eaf89-590e-4119-8559-f9a63b2ba713-kube-api-access-c4k4r\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:09.931943 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:09.931805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994eaf89-590e-4119-8559-f9a63b2ba713-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.032904 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.032868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994eaf89-590e-4119-8559-f9a63b2ba713-maas-api-tls\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.033101 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.032916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4k4r\" (UniqueName: \"kubernetes.io/projected/994eaf89-590e-4119-8559-f9a63b2ba713-kube-api-access-c4k4r\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.033101 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.032934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994eaf89-590e-4119-8559-f9a63b2ba713-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.033596 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.033577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994eaf89-590e-4119-8559-f9a63b2ba713-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.035425 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.035404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994eaf89-590e-4119-8559-f9a63b2ba713-maas-api-tls\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.041131 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.041108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4k4r\" (UniqueName: \"kubernetes.io/projected/994eaf89-590e-4119-8559-f9a63b2ba713-kube-api-access-c4k4r\") pod \"maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.146024 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.145947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:10.283651 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.283526    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"]
Jul 31 00:52:10.286012 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:52:10.285978    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994eaf89_590e_4119_8559_f9a63b2ba713.slice/crio-b880b6201f7982c2cce98fd3b41f587ea76ef815f294373530f51bfc1ccfad75 WatchSource:0}: Error finding container b880b6201f7982c2cce98fd3b41f587ea76ef815f294373530f51bfc1ccfad75: Status 404 returned error can't find the container with id b880b6201f7982c2cce98fd3b41f587ea76ef815f294373530f51bfc1ccfad75
Jul 31 00:52:10.487658 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:10.487545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh" event={"ID":"994eaf89-590e-4119-8559-f9a63b2ba713","Type":"ContainerStarted","Data":"b880b6201f7982c2cce98fd3b41f587ea76ef815f294373530f51bfc1ccfad75"}
Jul 31 00:52:11.499817 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:11.499779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh" event={"ID":"994eaf89-590e-4119-8559-f9a63b2ba713","Type":"ContainerStarted","Data":"35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df"}
Jul 31 00:52:11.500247 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:11.499946    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:52:11.515509 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:11.515453    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh" podStartSLOduration=2.182465583 podStartE2EDuration="2.51543721s" totalImagesPullingTime="332.971627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:52:11.514972699 +0000 UTC m=+2771.792215690" watchObservedRunningTime="2026-07-31 00:52:11.51543721 +0000 UTC m=+2771.792680215"
Jul 31 00:52:17.510344 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:52:17.510307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:54:11.602151 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.602116    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"]
Jul 31 00:54:11.602607 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.602387    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2" podUID="74219895-4f24-4973-adaa-2bfd26939ad9" containerName="maas-api" containerID="cri-o://3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f" gracePeriod=30
Jul 31 00:54:11.862904 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.862844    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:54:11.966654 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.966605    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74219895-4f24-4973-adaa-2bfd26939ad9-openshift-service-ca\") pod \"74219895-4f24-4973-adaa-2bfd26939ad9\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") "
Jul 31 00:54:11.966816 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.966670    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74219895-4f24-4973-adaa-2bfd26939ad9-maas-api-tls\") pod \"74219895-4f24-4973-adaa-2bfd26939ad9\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") "
Jul 31 00:54:11.966816 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.966729    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8fgq\" (UniqueName: \"kubernetes.io/projected/74219895-4f24-4973-adaa-2bfd26939ad9-kube-api-access-h8fgq\") pod \"74219895-4f24-4973-adaa-2bfd26939ad9\" (UID: \"74219895-4f24-4973-adaa-2bfd26939ad9\") "
Jul 31 00:54:11.966994 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.966972    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74219895-4f24-4973-adaa-2bfd26939ad9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "74219895-4f24-4973-adaa-2bfd26939ad9" (UID: "74219895-4f24-4973-adaa-2bfd26939ad9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:11.967121 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.967104    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74219895-4f24-4973-adaa-2bfd26939ad9-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:11.968901 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.968873    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74219895-4f24-4973-adaa-2bfd26939ad9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "74219895-4f24-4973-adaa-2bfd26939ad9" (UID: "74219895-4f24-4973-adaa-2bfd26939ad9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:54:11.968901 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:11.968889    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74219895-4f24-4973-adaa-2bfd26939ad9-kube-api-access-h8fgq" (OuterVolumeSpecName: "kube-api-access-h8fgq") pod "74219895-4f24-4973-adaa-2bfd26939ad9" (UID: "74219895-4f24-4973-adaa-2bfd26939ad9"). InnerVolumeSpecName "kube-api-access-h8fgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:12.067944 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.067912    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74219895-4f24-4973-adaa-2bfd26939ad9-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:12.067944 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.067937    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8fgq\" (UniqueName: \"kubernetes.io/projected/74219895-4f24-4973-adaa-2bfd26939ad9-kube-api-access-h8fgq\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:12.157828 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.157737    2582 generic.go:356] "Generic (PLEG): container finished" podID="74219895-4f24-4973-adaa-2bfd26939ad9" containerID="3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f" exitCode=0
Jul 31 00:54:12.157828 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.157786    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"
Jul 31 00:54:12.158067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.157828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2" event={"ID":"74219895-4f24-4973-adaa-2bfd26939ad9","Type":"ContainerDied","Data":"3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f"}
Jul 31 00:54:12.158067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.157886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2" event={"ID":"74219895-4f24-4973-adaa-2bfd26939ad9","Type":"ContainerDied","Data":"b13f7619e2dea3cda7f58534d18a782613421f864afccf7ac780f16e6aa7f939"}
Jul 31 00:54:12.158067 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.157916    2582 scope.go:117] "RemoveContainer" containerID="3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f"
Jul 31 00:54:12.167969 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.167949    2582 scope.go:117] "RemoveContainer" containerID="3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f"
Jul 31 00:54:12.168246 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:54:12.168228    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f\": container with ID starting with 3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f not found: ID does not exist" containerID="3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f"
Jul 31 00:54:12.168316 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.168252    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f"} err="failed to get container status \"3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f\": rpc error: code = NotFound desc = could not find container \"3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f\": container with ID starting with 3c3c1ec217e7188907b313a1b848dd4f1bf9103c05844a909ee22cd532a8435f not found: ID does not exist"
Jul 31 00:54:12.181292 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.181268    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"]
Jul 31 00:54:12.186667 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.186643    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c23a2c-df9445fd4-jskm2"]
Jul 31 00:54:12.248664 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:12.248609    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74219895-4f24-4973-adaa-2bfd26939ad9" path="/var/lib/kubelet/pods/74219895-4f24-4973-adaa-2bfd26939ad9/volumes"
Jul 31 00:54:18.198494 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:18.198453    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"]
Jul 31 00:54:18.198910 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:18.198666    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy" containerID="cri-o://c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c" gracePeriod=30
Jul 31 00:54:23.457742 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.457709    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:54:23.467572 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-socket\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467572 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467542    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-envoy\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467572 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksbfw\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-kube-api-access-ksbfw\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467804 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467585    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-certs\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467804 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467605    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-credential-socket\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467804 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467781    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e8a8807-5e17-44bf-9942-23169e2dc55a-istiod-ca-cert\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467827    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-token\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467832    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:23.467972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467860    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-podinfo\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.467972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467872    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:23.467972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467893    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:23.467972 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.467909    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-data\") pod \"1e8a8807-5e17-44bf-9942-23169e2dc55a\" (UID: \"1e8a8807-5e17-44bf-9942-23169e2dc55a\") "
Jul 31 00:54:23.468252 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.468140    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:23.468310 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.468248    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e8a8807-5e17-44bf-9942-23169e2dc55a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:23.468310 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.468299    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.468416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.468317    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.468416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.468330    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.468416 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.468344    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.469900 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.469871    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 00:54:23.470012 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.469918    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:54:23.470012 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.469959    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-kube-api-access-ksbfw" (OuterVolumeSpecName: "kube-api-access-ksbfw") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "kube-api-access-ksbfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:23.470012 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.469986    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e8a8807-5e17-44bf-9942-23169e2dc55a" (UID: "1e8a8807-5e17-44bf-9942-23169e2dc55a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:23.568819 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.568783    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.568819 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.568815    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksbfw\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-kube-api-access-ksbfw\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.569034 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.568829    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e8a8807-5e17-44bf-9942-23169e2dc55a-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.569034 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.568841    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:23.569034 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:23.568852    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e8a8807-5e17-44bf-9942-23169e2dc55a-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:24.229473 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.229435    2582 generic.go:356] "Generic (PLEG): container finished" podID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerID="c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c" exitCode=0
Jul 31 00:54:24.229709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.229484    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"
Jul 31 00:54:24.229709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.229512    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" event={"ID":"1e8a8807-5e17-44bf-9942-23169e2dc55a","Type":"ContainerDied","Data":"c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c"}
Jul 31 00:54:24.229709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.229575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49" event={"ID":"1e8a8807-5e17-44bf-9942-23169e2dc55a","Type":"ContainerDied","Data":"a56a2c14c910752bd8174092c24603e11aee67361d35b8fb36c47a9a598e4f6b"}
Jul 31 00:54:24.229709 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.229606    2582 scope.go:117] "RemoveContainer" containerID="c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c"
Jul 31 00:54:24.239396 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.239375    2582 scope.go:117] "RemoveContainer" containerID="47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772"
Jul 31 00:54:24.249102 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.248960    2582 scope.go:117] "RemoveContainer" containerID="c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c"
Jul 31 00:54:24.249292 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:54:24.249244    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c\": container with ID starting with c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c not found: ID does not exist" containerID="c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c"
Jul 31 00:54:24.249408 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.249296    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c"} err="failed to get container status \"c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c\": rpc error: code = NotFound desc = could not find container \"c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c\": container with ID starting with c6319f7abc8db1179be4d356fa7f53132ed058f9a561ede05ca2a9e903d6d66c not found: ID does not exist"
Jul 31 00:54:24.249408 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.249321    2582 scope.go:117] "RemoveContainer" containerID="47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772"
Jul 31 00:54:24.249586 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:54:24.249564    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772\": container with ID starting with 47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772 not found: ID does not exist" containerID="47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772"
Jul 31 00:54:24.249719 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.249592    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772"} err="failed to get container status \"47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772\": rpc error: code = NotFound desc = could not find container \"47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772\": container with ID starting with 47782f4290c7c20bfecd5d4a35d80fd0a714b7f90cee6a589baa2f32fc343772 not found: ID does not exist"
Jul 31 00:54:24.251905 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.251880    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"]
Jul 31 00:54:24.254662 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:24.254640    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c23a2c-openshift-default-79c9f55f58-26p49"]
Jul 31 00:54:26.248276 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:26.248230    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" path="/var/lib/kubelet/pods/1e8a8807-5e17-44bf-9942-23169e2dc55a/volumes"
Jul 31 00:54:29.165105 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.165063    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"]
Jul 31 00:54:29.165593 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.165321    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh" podUID="994eaf89-590e-4119-8559-f9a63b2ba713" containerName="maas-api" containerID="cri-o://35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df" gracePeriod=30
Jul 31 00:54:29.638661 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.638614    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:54:29.718477 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.718398    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994eaf89-590e-4119-8559-f9a63b2ba713-maas-api-tls\") pod \"994eaf89-590e-4119-8559-f9a63b2ba713\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") "
Jul 31 00:54:29.718477 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.718444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4k4r\" (UniqueName: \"kubernetes.io/projected/994eaf89-590e-4119-8559-f9a63b2ba713-kube-api-access-c4k4r\") pod \"994eaf89-590e-4119-8559-f9a63b2ba713\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") "
Jul 31 00:54:29.718477 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.718474    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994eaf89-590e-4119-8559-f9a63b2ba713-openshift-service-ca\") pod \"994eaf89-590e-4119-8559-f9a63b2ba713\" (UID: \"994eaf89-590e-4119-8559-f9a63b2ba713\") "
Jul 31 00:54:29.718848 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.718826    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/994eaf89-590e-4119-8559-f9a63b2ba713-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "994eaf89-590e-4119-8559-f9a63b2ba713" (UID: "994eaf89-590e-4119-8559-f9a63b2ba713"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:54:29.720480 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.720454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/994eaf89-590e-4119-8559-f9a63b2ba713-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "994eaf89-590e-4119-8559-f9a63b2ba713" (UID: "994eaf89-590e-4119-8559-f9a63b2ba713"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:54:29.720581 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.720486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994eaf89-590e-4119-8559-f9a63b2ba713-kube-api-access-c4k4r" (OuterVolumeSpecName: "kube-api-access-c4k4r") pod "994eaf89-590e-4119-8559-f9a63b2ba713" (UID: "994eaf89-590e-4119-8559-f9a63b2ba713"). InnerVolumeSpecName "kube-api-access-c4k4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:54:29.819963 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.819929    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/994eaf89-590e-4119-8559-f9a63b2ba713-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:29.819963 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.819956    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4k4r\" (UniqueName: \"kubernetes.io/projected/994eaf89-590e-4119-8559-f9a63b2ba713-kube-api-access-c4k4r\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:29.819963 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:29.819968    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/994eaf89-590e-4119-8559-f9a63b2ba713-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:54:30.264905 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.264869    2582 generic.go:356] "Generic (PLEG): container finished" podID="994eaf89-590e-4119-8559-f9a63b2ba713" containerID="35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df" exitCode=0
Jul 31 00:54:30.265292 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.264915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"
Jul 31 00:54:30.265292 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.264931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh" event={"ID":"994eaf89-590e-4119-8559-f9a63b2ba713","Type":"ContainerDied","Data":"35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df"}
Jul 31 00:54:30.265292 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.264983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh" event={"ID":"994eaf89-590e-4119-8559-f9a63b2ba713","Type":"ContainerDied","Data":"b880b6201f7982c2cce98fd3b41f587ea76ef815f294373530f51bfc1ccfad75"}
Jul 31 00:54:30.265292 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.265013    2582 scope.go:117] "RemoveContainer" containerID="35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df"
Jul 31 00:54:30.274375 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.274350    2582 scope.go:117] "RemoveContainer" containerID="35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df"
Jul 31 00:54:30.274664 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:54:30.274644    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df\": container with ID starting with 35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df not found: ID does not exist" containerID="35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df"
Jul 31 00:54:30.274753 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.274672    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df"} err="failed to get container status \"35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df\": rpc error: code = NotFound desc = could not find container \"35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df\": container with ID starting with 35f0ef259c14222c7bf2109782d7d08b26d7ae5448f3ac49f949eaa29f6459df not found: ID does not exist"
Jul 31 00:54:30.281278 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.281243    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"]
Jul 31 00:54:30.285606 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:30.285582    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-0fc38b-75c68c6d4c-7gglh"]
Jul 31 00:54:32.252174 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:32.252128    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="994eaf89-590e-4119-8559-f9a63b2ba713" path="/var/lib/kubelet/pods/994eaf89-590e-4119-8559-f9a63b2ba713/volumes"
Jul 31 00:54:36.603775 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.603736    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"]
Jul 31 00:54:36.604293 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604277    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy"
Jul 31 00:54:36.604346 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604296    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy"
Jul 31 00:54:36.604346 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604316    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994eaf89-590e-4119-8559-f9a63b2ba713" containerName="maas-api"
Jul 31 00:54:36.604346 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604324    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="994eaf89-590e-4119-8559-f9a63b2ba713" containerName="maas-api"
Jul 31 00:54:36.604346 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604343    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74219895-4f24-4973-adaa-2bfd26939ad9" containerName="maas-api"
Jul 31 00:54:36.604473 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604351    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="74219895-4f24-4973-adaa-2bfd26939ad9" containerName="maas-api"
Jul 31 00:54:36.604473 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604449    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="74219895-4f24-4973-adaa-2bfd26939ad9" containerName="maas-api"
Jul 31 00:54:36.604473 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604461    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy"
Jul 31 00:54:36.604564 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604474    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy"
Jul 31 00:54:36.604564 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.604485    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="994eaf89-590e-4119-8559-f9a63b2ba713" containerName="maas-api"
Jul 31 00:54:36.609229 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.609209    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.612104 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.612085    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-943c1a-openshift-default-dockercfg-jqwnl\""
Jul 31 00:54:36.617881 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.617860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"]
Jul 31 00:54:36.676271 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-envoy\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676453 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-podinfo\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676453 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-socket\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676453 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-credential-socket\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676453 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-certs\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676682 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-data\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676682 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsz2w\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-kube-api-access-tsz2w\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676682 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-token\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.676786 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.676737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istiod-ca-cert\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777469 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsz2w\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-kube-api-access-tsz2w\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-token\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istiod-ca-cert\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-envoy\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-podinfo\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-socket\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-credential-socket\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.777699 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-certs\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.778049 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.777736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-data\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.778049 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.778023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-socket\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.778155 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.778088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-credential-socket\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.778155 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.778096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-certs\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.778267 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.778180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-data\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.778425 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.778408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istiod-ca-cert\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.780071 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.780051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-envoy\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.780239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.780216    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-podinfo\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.785951 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.785918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-token\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.786041 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.785955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsz2w\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-kube-api-access-tsz2w\") pod \"e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") " pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:36.920423 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:36.920344    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:37.053952 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.053925    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"]
Jul 31 00:54:37.054963 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:54:37.054941    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee4bbc7_bea6_4964_a392_681ede5bd5cd.slice/crio-23e0d80bc1cb808a5fdf96b2d87caa86cad30cef4c0b4cd55693b136fb55596f WatchSource:0}: Error finding container 23e0d80bc1cb808a5fdf96b2d87caa86cad30cef4c0b4cd55693b136fb55596f: Status 404 returned error can't find the container with id 23e0d80bc1cb808a5fdf96b2d87caa86cad30cef4c0b4cd55693b136fb55596f
Jul 31 00:54:37.057022 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.056991    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:54:37.057087 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.057060    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:54:37.057124 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.057089    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:54:37.311750 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.311712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" event={"ID":"9ee4bbc7-bea6-4964-a392-681ede5bd5cd","Type":"ContainerStarted","Data":"bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b"}
Jul 31 00:54:37.311908 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.311773    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" event={"ID":"9ee4bbc7-bea6-4964-a392-681ede5bd5cd","Type":"ContainerStarted","Data":"23e0d80bc1cb808a5fdf96b2d87caa86cad30cef4c0b4cd55693b136fb55596f"}
Jul 31 00:54:37.331136 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.331088    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" podStartSLOduration=1.331070289 podStartE2EDuration="1.331070289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:54:37.329219549 +0000 UTC m=+2917.606462540" watchObservedRunningTime="2026-07-31 00:54:37.331070289 +0000 UTC m=+2917.608313279"
Jul 31 00:54:37.920713 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:37.920675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:38.926163 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:38.926135    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:39.321772 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:39.321742    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:39.322855 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:39.322836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:40.486350 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.486316    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"]
Jul 31 00:54:40.486784 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.486754    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy"
Jul 31 00:54:40.486784 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.486769    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e8a8807-5e17-44bf-9942-23169e2dc55a" containerName="istio-proxy"
Jul 31 00:54:40.489608 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.489592    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.492246 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.492222    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-943c1a-serving-cert\""
Jul 31 00:54:40.492364 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.492322    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:54:40.501305 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.501280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"]
Jul 31 00:54:40.513516 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.513494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqlpf\" (UniqueName: \"kubernetes.io/projected/593b7686-c911-4344-a456-8be6d9673fc9-kube-api-access-gqlpf\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.513619 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.513548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593b7686-c911-4344-a456-8be6d9673fc9-openshift-service-ca\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.513692 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.513653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.614499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.614465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqlpf\" (UniqueName: \"kubernetes.io/projected/593b7686-c911-4344-a456-8be6d9673fc9-kube-api-access-gqlpf\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.614675 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.614515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593b7686-c911-4344-a456-8be6d9673fc9-openshift-service-ca\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.614675 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.614552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.614791 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:54:40.614771    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-serving-cert: secret "maas-api-e2e-api-a-943c1a-serving-cert" not found
Jul 31 00:54:40.614849 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:54:40.614839    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls podName:593b7686-c911-4344-a456-8be6d9673fc9 nodeName:}" failed. No retries permitted until 2026-07-31 00:54:41.114819859 +0000 UTC m=+2921.392062830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls") pod "maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x" (UID: "593b7686-c911-4344-a456-8be6d9673fc9") : secret "maas-api-e2e-api-a-943c1a-serving-cert" not found
Jul 31 00:54:40.615205 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.615187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593b7686-c911-4344-a456-8be6d9673fc9-openshift-service-ca\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:40.622838 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:40.622817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqlpf\" (UniqueName: \"kubernetes.io/projected/593b7686-c911-4344-a456-8be6d9673fc9-kube-api-access-gqlpf\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:41.119651 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:41.119586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:41.122080 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:41.122057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls\") pod \"maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:41.403950 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:41.403867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:41.534649 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:41.534609    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"]
Jul 31 00:54:41.535084 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:54:41.535058    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593b7686_c911_4344_a456_8be6d9673fc9.slice/crio-c0bebbe148912f8dd2b22d969e2bc809da4030a76a3c21abcf6544eb1fd0b05a WatchSource:0}: Error finding container c0bebbe148912f8dd2b22d969e2bc809da4030a76a3c21abcf6544eb1fd0b05a: Status 404 returned error can't find the container with id c0bebbe148912f8dd2b22d969e2bc809da4030a76a3c21abcf6544eb1fd0b05a
Jul 31 00:54:41.536603 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:41.536583    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 00:54:42.342336 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:42.342301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x" event={"ID":"593b7686-c911-4344-a456-8be6d9673fc9","Type":"ContainerStarted","Data":"ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713"}
Jul 31 00:54:42.342499 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:42.342467    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:42.342546 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:42.342511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x" event={"ID":"593b7686-c911-4344-a456-8be6d9673fc9","Type":"ContainerStarted","Data":"c0bebbe148912f8dd2b22d969e2bc809da4030a76a3c21abcf6544eb1fd0b05a"}
Jul 31 00:54:42.360603 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:42.360509    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x" podStartSLOduration=1.7928103659999999 podStartE2EDuration="2.360493889s" totalImagesPullingTime="567.683523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:54:42.358889388 +0000 UTC m=+2922.636132370" watchObservedRunningTime="2026-07-31 00:54:42.360493889 +0000 UTC m=+2922.637736880"
Jul 31 00:54:48.354854 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:48.354828    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:54:52.405287 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:52.405182    2582 generic.go:356] "Generic (PLEG): container finished" podID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerID="bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b" exitCode=0
Jul 31 00:54:52.405287 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:52.405260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" event={"ID":"9ee4bbc7-bea6-4964-a392-681ede5bd5cd","Type":"ContainerDied","Data":"bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b"}
Jul 31 00:54:52.405727 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:52.405683    2582 scope.go:117] "RemoveContainer" containerID="bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b"
Jul 31 00:54:52.406829 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:52.406803    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:54:52.406912 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:52.406868    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:54:52.406912 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:52.406908    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:54:53.413097 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:53.413063    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" event={"ID":"9ee4bbc7-bea6-4964-a392-681ede5bd5cd","Type":"ContainerStarted","Data":"c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9"}
Jul 31 00:54:53.921566 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:53.921526    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:53.922688 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:53.922655    2582 patch_prober.go:28] interesting pod/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 31 00:54:53.922834 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:53.922737    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 31 00:54:54.322266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:54.322232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:54.921491 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:54.921461    2582 patch_prober.go:28] interesting pod/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 31 00:54:54.921895 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:54.921522    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 31 00:54:55.921554 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:55.921518    2582 patch_prober.go:28] interesting pod/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 31 00:54:55.921951 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:55.921572    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 31 00:54:56.921014 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:56.920977    2582 patch_prober.go:28] interesting pod/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 31 00:54:56.921262 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:56.921050    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 31 00:54:57.920741 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:57.920705    2582 patch_prober.go:28] interesting pod/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 31 00:54:57.921131 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:57.920757    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 31 00:54:58.924551 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:58.924520    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:54:58.925491 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:54:58.925472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:55:08.724737 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.724692    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"]
Jul 31 00:55:08.727857 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.727833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.730493 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.730475    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-53f734-serving-cert\""
Jul 31 00:55:08.738606 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.738583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"]
Jul 31 00:55:08.793415 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.793379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbace8-d134-431b-96ff-f71d22d0fc7d-openshift-service-ca\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.793574 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.793452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7dbace8-d134-431b-96ff-f71d22d0fc7d-maas-api-tls\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.793574 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.793493    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jln6\" (UniqueName: \"kubernetes.io/projected/b7dbace8-d134-431b-96ff-f71d22d0fc7d-kube-api-access-8jln6\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.894553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.894514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jln6\" (UniqueName: \"kubernetes.io/projected/b7dbace8-d134-431b-96ff-f71d22d0fc7d-kube-api-access-8jln6\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.894553 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.894561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbace8-d134-431b-96ff-f71d22d0fc7d-openshift-service-ca\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.894848 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.894661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7dbace8-d134-431b-96ff-f71d22d0fc7d-maas-api-tls\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.895388 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.895365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbace8-d134-431b-96ff-f71d22d0fc7d-openshift-service-ca\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.897167 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.897146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7dbace8-d134-431b-96ff-f71d22d0fc7d-maas-api-tls\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:08.902767 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:08.902744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jln6\" (UniqueName: \"kubernetes.io/projected/b7dbace8-d134-431b-96ff-f71d22d0fc7d-kube-api-access-8jln6\") pod \"maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:09.041440 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:09.041400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:09.174396 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:09.174364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"]
Jul 31 00:55:09.176161 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:55:09.176132    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dbace8_d134_431b_96ff_f71d22d0fc7d.slice/crio-183f877e9b15abc1878846a352818a50ef0123164354b18ff2d945a7149a6cd7 WatchSource:0}: Error finding container 183f877e9b15abc1878846a352818a50ef0123164354b18ff2d945a7149a6cd7: Status 404 returned error can't find the container with id 183f877e9b15abc1878846a352818a50ef0123164354b18ff2d945a7149a6cd7
Jul 31 00:55:09.511533 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:09.511491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p" event={"ID":"b7dbace8-d134-431b-96ff-f71d22d0fc7d","Type":"ContainerStarted","Data":"183f877e9b15abc1878846a352818a50ef0123164354b18ff2d945a7149a6cd7"}
Jul 31 00:55:10.518856 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:10.518824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p" event={"ID":"b7dbace8-d134-431b-96ff-f71d22d0fc7d","Type":"ContainerStarted","Data":"d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb"}
Jul 31 00:55:10.519230 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:10.518885    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:10.536239 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:10.536192    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p" podStartSLOduration=2.190901779 podStartE2EDuration="2.536177303s" totalImagesPullingTime="345.275524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:55:10.53458081 +0000 UTC m=+2950.811823799" watchObservedRunningTime="2026-07-31 00:55:10.536177303 +0000 UTC m=+2950.813420292"
Jul 31 00:55:16.535714 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:16.535686    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:55:56.215944 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.215910    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"]
Jul 31 00:55:56.216405 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.216153    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x" podUID="593b7686-c911-4344-a456-8be6d9673fc9" containerName="maas-api" containerID="cri-o://ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713" gracePeriod=30
Jul 31 00:55:56.468071 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.467988    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:55:56.535388 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.535359    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593b7686-c911-4344-a456-8be6d9673fc9-openshift-service-ca\") pod \"593b7686-c911-4344-a456-8be6d9673fc9\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") "
Jul 31 00:55:56.535572 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.535403    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls\") pod \"593b7686-c911-4344-a456-8be6d9673fc9\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") "
Jul 31 00:55:56.535572 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.535455    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqlpf\" (UniqueName: \"kubernetes.io/projected/593b7686-c911-4344-a456-8be6d9673fc9-kube-api-access-gqlpf\") pod \"593b7686-c911-4344-a456-8be6d9673fc9\" (UID: \"593b7686-c911-4344-a456-8be6d9673fc9\") "
Jul 31 00:55:56.535778 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.535753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/593b7686-c911-4344-a456-8be6d9673fc9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "593b7686-c911-4344-a456-8be6d9673fc9" (UID: "593b7686-c911-4344-a456-8be6d9673fc9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:55:56.537479 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.537452    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "593b7686-c911-4344-a456-8be6d9673fc9" (UID: "593b7686-c911-4344-a456-8be6d9673fc9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:55:56.537569 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.537493    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593b7686-c911-4344-a456-8be6d9673fc9-kube-api-access-gqlpf" (OuterVolumeSpecName: "kube-api-access-gqlpf") pod "593b7686-c911-4344-a456-8be6d9673fc9" (UID: "593b7686-c911-4344-a456-8be6d9673fc9"). InnerVolumeSpecName "kube-api-access-gqlpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:55:56.636598 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.636560    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593b7686-c911-4344-a456-8be6d9673fc9-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:55:56.636598 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.636591    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593b7686-c911-4344-a456-8be6d9673fc9-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:55:56.636598 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.636601    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqlpf\" (UniqueName: \"kubernetes.io/projected/593b7686-c911-4344-a456-8be6d9673fc9-kube-api-access-gqlpf\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:55:56.783604 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.783573    2582 generic.go:356] "Generic (PLEG): container finished" podID="593b7686-c911-4344-a456-8be6d9673fc9" containerID="ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713" exitCode=0
Jul 31 00:55:56.783802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.783648    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"
Jul 31 00:55:56.783802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.783663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x" event={"ID":"593b7686-c911-4344-a456-8be6d9673fc9","Type":"ContainerDied","Data":"ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713"}
Jul 31 00:55:56.783802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.783714    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x" event={"ID":"593b7686-c911-4344-a456-8be6d9673fc9","Type":"ContainerDied","Data":"c0bebbe148912f8dd2b22d969e2bc809da4030a76a3c21abcf6544eb1fd0b05a"}
Jul 31 00:55:56.783802 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.783738    2582 scope.go:117] "RemoveContainer" containerID="ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713"
Jul 31 00:55:56.793671 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.793657    2582 scope.go:117] "RemoveContainer" containerID="ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713"
Jul 31 00:55:56.793916 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:55:56.793897    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713\": container with ID starting with ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713 not found: ID does not exist" containerID="ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713"
Jul 31 00:55:56.793961 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.793924    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713"} err="failed to get container status \"ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713\": rpc error: code = NotFound desc = could not find container \"ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713\": container with ID starting with ec86863bd62d6ab4918e6a07e05c17e66902b6129e2d6bc294b9f44b62986713 not found: ID does not exist"
Jul 31 00:55:56.806122 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.806096    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"]
Jul 31 00:55:56.808339 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:56.808320    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-943c1a-6b58d7b74b-gtv6x"]
Jul 31 00:55:58.247744 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:55:58.247709    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593b7686-c911-4344-a456-8be6d9673fc9" path="/var/lib/kubelet/pods/593b7686-c911-4344-a456-8be6d9673fc9/volumes"
Jul 31 00:56:00.502381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:00.502348    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:56:00.509491 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:00.509466    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:56:00.512023 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:00.512004    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 00:56:00.522327 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:00.522310    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 00:56:02.884963 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:02.884929    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"]
Jul 31 00:56:02.885457 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:02.885208    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy" containerID="cri-o://c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9" gracePeriod=30
Jul 31 00:56:08.158148 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.158085    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:56:08.245381 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsz2w\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-kube-api-access-tsz2w\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-envoy\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245449    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istiod-ca-cert\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245479    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-credential-socket\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245508    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-certs\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245560 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245549    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-podinfo\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245584    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-token\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-socket\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-data\") pod \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\" (UID: \"9ee4bbc7-bea6-4964-a392-681ede5bd5cd\") "
Jul 31 00:56:08.245866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245827    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:56:08.245866 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.245852    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:56:08.246112 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.246065    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:56:08.246168 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.246144    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.246221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.246165    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.246221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.246162    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:56:08.246221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.246180    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.246367 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.246261    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:56:08.247907 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.247878    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-kube-api-access-tsz2w" (OuterVolumeSpecName: "kube-api-access-tsz2w") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "kube-api-access-tsz2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:56:08.248198 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.248169    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 00:56:08.248198 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.248188    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 00:56:08.248348 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.248177    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ee4bbc7-bea6-4964-a392-681ede5bd5cd" (UID: "9ee4bbc7-bea6-4964-a392-681ede5bd5cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:56:08.347115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.347079    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.347115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.347108    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsz2w\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-kube-api-access-tsz2w\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.347115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.347117    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.347115 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.347124    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.347402 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.347132    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.347402 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.347140    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ee4bbc7-bea6-4964-a392-681ede5bd5cd-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:08.856210 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.856174    2582 generic.go:356] "Generic (PLEG): container finished" podID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerID="c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9" exitCode=0
Jul 31 00:56:08.856409 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.856242    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"
Jul 31 00:56:08.856409 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.856259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" event={"ID":"9ee4bbc7-bea6-4964-a392-681ede5bd5cd","Type":"ContainerDied","Data":"c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9"}
Jul 31 00:56:08.856409 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.856316    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht" event={"ID":"9ee4bbc7-bea6-4964-a392-681ede5bd5cd","Type":"ContainerDied","Data":"23e0d80bc1cb808a5fdf96b2d87caa86cad30cef4c0b4cd55693b136fb55596f"}
Jul 31 00:56:08.856409 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.856346    2582 scope.go:117] "RemoveContainer" containerID="c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9"
Jul 31 00:56:08.865869 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.865851    2582 scope.go:117] "RemoveContainer" containerID="bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b"
Jul 31 00:56:08.874578 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.874561    2582 scope.go:117] "RemoveContainer" containerID="c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9"
Jul 31 00:56:08.874931 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:56:08.874905    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9\": container with ID starting with c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9 not found: ID does not exist" containerID="c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9"
Jul 31 00:56:08.875092 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.874938    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9"} err="failed to get container status \"c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9\": rpc error: code = NotFound desc = could not find container \"c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9\": container with ID starting with c73844f0e16cdaeff66ba434be16c8a656de6100d6d1ff99e054ea3baa6fd9f9 not found: ID does not exist"
Jul 31 00:56:08.875092 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.874964    2582 scope.go:117] "RemoveContainer" containerID="bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b"
Jul 31 00:56:08.875711 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:56:08.875683    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b\": container with ID starting with bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b not found: ID does not exist" containerID="bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b"
Jul 31 00:56:08.875818 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.875715    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b"} err="failed to get container status \"bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b\": rpc error: code = NotFound desc = could not find container \"bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b\": container with ID starting with bf1bfce824ec6f1b6a395b86f5545276337451bb842970e43e9481888a86de6b not found: ID does not exist"
Jul 31 00:56:08.876220 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.876207    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"]
Jul 31 00:56:08.878498 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:08.878465    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-943c1a-openshift-default-6c778c5bc8-qdnht"]
Jul 31 00:56:10.248607 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:10.248569    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" path="/var/lib/kubelet/pods/9ee4bbc7-bea6-4964-a392-681ede5bd5cd/volumes"
Jul 31 00:56:18.826733 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:18.826682    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"]
Jul 31 00:56:18.827295 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:18.827116    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p" podUID="b7dbace8-d134-431b-96ff-f71d22d0fc7d" containerName="maas-api" containerID="cri-o://d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb" gracePeriod=30
Jul 31 00:56:19.083936 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.083878    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:56:19.251574 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.251536    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbace8-d134-431b-96ff-f71d22d0fc7d-openshift-service-ca\") pod \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") "
Jul 31 00:56:19.251794 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.251607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7dbace8-d134-431b-96ff-f71d22d0fc7d-maas-api-tls\") pod \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") "
Jul 31 00:56:19.251794 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.251686    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jln6\" (UniqueName: \"kubernetes.io/projected/b7dbace8-d134-431b-96ff-f71d22d0fc7d-kube-api-access-8jln6\") pod \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\" (UID: \"b7dbace8-d134-431b-96ff-f71d22d0fc7d\") "
Jul 31 00:56:19.251957 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.251925    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7dbace8-d134-431b-96ff-f71d22d0fc7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7dbace8-d134-431b-96ff-f71d22d0fc7d" (UID: "b7dbace8-d134-431b-96ff-f71d22d0fc7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 00:56:19.253740 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.253715    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7dbace8-d134-431b-96ff-f71d22d0fc7d-kube-api-access-8jln6" (OuterVolumeSpecName: "kube-api-access-8jln6") pod "b7dbace8-d134-431b-96ff-f71d22d0fc7d" (UID: "b7dbace8-d134-431b-96ff-f71d22d0fc7d"). InnerVolumeSpecName "kube-api-access-8jln6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 00:56:19.253800 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.253759    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7dbace8-d134-431b-96ff-f71d22d0fc7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7dbace8-d134-431b-96ff-f71d22d0fc7d" (UID: "b7dbace8-d134-431b-96ff-f71d22d0fc7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 00:56:19.352763 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.352680    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7dbace8-d134-431b-96ff-f71d22d0fc7d-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:19.352763 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.352710    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jln6\" (UniqueName: \"kubernetes.io/projected/b7dbace8-d134-431b-96ff-f71d22d0fc7d-kube-api-access-8jln6\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:19.352763 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.352720    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7dbace8-d134-431b-96ff-f71d22d0fc7d-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 00:56:19.918960 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.918921    2582 generic.go:356] "Generic (PLEG): container finished" podID="b7dbace8-d134-431b-96ff-f71d22d0fc7d" containerID="d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb" exitCode=0
Jul 31 00:56:19.919395 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.918977    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"
Jul 31 00:56:19.919395 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.919008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p" event={"ID":"b7dbace8-d134-431b-96ff-f71d22d0fc7d","Type":"ContainerDied","Data":"d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb"}
Jul 31 00:56:19.919395 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.919056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p" event={"ID":"b7dbace8-d134-431b-96ff-f71d22d0fc7d","Type":"ContainerDied","Data":"183f877e9b15abc1878846a352818a50ef0123164354b18ff2d945a7149a6cd7"}
Jul 31 00:56:19.919395 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.919080    2582 scope.go:117] "RemoveContainer" containerID="d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb"
Jul 31 00:56:19.928395 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.928378    2582 scope.go:117] "RemoveContainer" containerID="d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb"
Jul 31 00:56:19.928664 ip-10-0-143-7 kubenswrapper[2582]: E0731 00:56:19.928645    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb\": container with ID starting with d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb not found: ID does not exist" containerID="d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb"
Jul 31 00:56:19.928716 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.928672    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb"} err="failed to get container status \"d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb\": rpc error: code = NotFound desc = could not find container \"d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb\": container with ID starting with d3d1bba6a590443ffa46641bee17c58dbcce923d2d60e9c903170cceeb26aacb not found: ID does not exist"
Jul 31 00:56:19.939607 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.939586    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"]
Jul 31 00:56:19.945599 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:19.945578    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-53f734-5d878fcbb8-xbf4p"]
Jul 31 00:56:20.249988 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:20.249916    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7dbace8-d134-431b-96ff-f71d22d0fc7d" path="/var/lib/kubelet/pods/b7dbace8-d134-431b-96ff-f71d22d0fc7d/volumes"
Jul 31 00:56:26.047525 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.047494    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"]
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.047992    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593b7686-c911-4344-a456-8be6d9673fc9" containerName="maas-api"
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048008    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="593b7686-c911-4344-a456-8be6d9673fc9" containerName="maas-api"
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048020    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7dbace8-d134-431b-96ff-f71d22d0fc7d" containerName="maas-api"
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048025    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7dbace8-d134-431b-96ff-f71d22d0fc7d" containerName="maas-api"
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048034    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy"
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048040    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy"
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048050    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy"
Jul 31 00:56:26.048088 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048055    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy"
Jul 31 00:56:26.048369 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048107    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="593b7686-c911-4344-a456-8be6d9673fc9" containerName="maas-api"
Jul 31 00:56:26.048369 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048116    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy"
Jul 31 00:56:26.048369 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.048124    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7dbace8-d134-431b-96ff-f71d22d0fc7d" containerName="maas-api"
Jul 31 00:56:26.052613 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.052595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.055166 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.055145    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6a2164-openshift-default-dockercfg-2g2qf\""
Jul 31 00:56:26.064059 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.064030    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"]
Jul 31 00:56:26.214859 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.214818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-socket\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.214859 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.214864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-istio-token\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.215057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.214888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa3f757-c433-41ef-9746-b5ee37064266-istio-podinfo\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.215057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.214963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-envoy\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.215057 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.214999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-certs\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.215158 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.215078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-credential-socket\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.215158 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.215121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-data\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.215158 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.215142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg4k8\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-kube-api-access-cg4k8\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.215254 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.215159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa3f757-c433-41ef-9746-b5ee37064266-istiod-ca-cert\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-envoy\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316334 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-certs\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316573 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-credential-socket\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316573 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-data\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316573 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg4k8\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-kube-api-access-cg4k8\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316573 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa3f757-c433-41ef-9746-b5ee37064266-istiod-ca-cert\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316573 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-socket\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316861 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-istio-token\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316861 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa3f757-c433-41ef-9746-b5ee37064266-istio-podinfo\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316861 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-certs\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.316861 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-data\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.317051 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.316964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-socket\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.317165 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.317143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa3f757-c433-41ef-9746-b5ee37064266-istiod-ca-cert\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.317286 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.317188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-credential-socket\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.319096 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.319068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-envoy\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.319182 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.319145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa3f757-c433-41ef-9746-b5ee37064266-istio-podinfo\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.325150 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.325127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg4k8\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-kube-api-access-cg4k8\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.325585 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.325565    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-istio-token\") pod \"e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") " pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.364684 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.364651    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:26.499468 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.499440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"]
Jul 31 00:56:26.500351 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:56:26.500331    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa3f757_c433_41ef_9746_b5ee37064266.slice/crio-ef9f45356b89ee25905772f9410898df8d2c280b9fbca5f4045ac3b274f02628 WatchSource:0}: Error finding container ef9f45356b89ee25905772f9410898df8d2c280b9fbca5f4045ac3b274f02628: Status 404 returned error can't find the container with id ef9f45356b89ee25905772f9410898df8d2c280b9fbca5f4045ac3b274f02628
Jul 31 00:56:26.503120 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.503087    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:56:26.503230 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.503164    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:56:26.503230 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.503195    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:56:26.960201 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.960149    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" event={"ID":"baa3f757-c433-41ef-9746-b5ee37064266","Type":"ContainerStarted","Data":"d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8"}
Jul 31 00:56:26.960388 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.960219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" event={"ID":"baa3f757-c433-41ef-9746-b5ee37064266","Type":"ContainerStarted","Data":"ef9f45356b89ee25905772f9410898df8d2c280b9fbca5f4045ac3b274f02628"}
Jul 31 00:56:26.980527 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:26.980478    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" podStartSLOduration=0.98046389 podStartE2EDuration="980.46389ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:56:26.97796164 +0000 UTC m=+3027.255204630" watchObservedRunningTime="2026-07-31 00:56:26.98046389 +0000 UTC m=+3027.257706878"
Jul 31 00:56:27.365409 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:27.365375    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:27.370099 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:27.370072    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:27.965888 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:27.965854    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:27.966740 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:27.966723    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:29.973184 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:29.973141    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"]
Jul 31 00:56:29.973813 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:29.973788    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee4bbc7-bea6-4964-a392-681ede5bd5cd" containerName="istio-proxy"
Jul 31 00:56:29.977062 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:29.977042    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:29.979530 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:29.979511    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9lzsm\""
Jul 31 00:56:29.979822 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:29.979807    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-6a2164-serving-cert\""
Jul 31 00:56:29.987174 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:29.987149    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"]
Jul 31 00:56:30.050938 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.050908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90217b54-3634-4fad-974c-212c7eb46b3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.051125 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.051037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90217b54-3634-4fad-974c-212c7eb46b3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.051213 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.051185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bmzr\" (UniqueName: \"kubernetes.io/projected/90217b54-3634-4fad-974c-212c7eb46b3d-kube-api-access-5bmzr\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.152455 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.152420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90217b54-3634-4fad-974c-212c7eb46b3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.152660 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.152462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bmzr\" (UniqueName: \"kubernetes.io/projected/90217b54-3634-4fad-974c-212c7eb46b3d-kube-api-access-5bmzr\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.152660 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.152521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90217b54-3634-4fad-974c-212c7eb46b3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.153221 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.153200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90217b54-3634-4fad-974c-212c7eb46b3d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.155078 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.155055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90217b54-3634-4fad-974c-212c7eb46b3d-maas-api-tls\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.160815 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.160791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bmzr\" (UniqueName: \"kubernetes.io/projected/90217b54-3634-4fad-974c-212c7eb46b3d-kube-api-access-5bmzr\") pod \"maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.288942 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.288909    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:30.421824 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.421794    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"]
Jul 31 00:56:30.423403 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:56:30.423373    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90217b54_3634_4fad_974c_212c7eb46b3d.slice/crio-78362b5ec483c5a3a3689c08fe519ea6e12d61ab0380e7a0e683be4f7ed40992 WatchSource:0}: Error finding container 78362b5ec483c5a3a3689c08fe519ea6e12d61ab0380e7a0e683be4f7ed40992: Status 404 returned error can't find the container with id 78362b5ec483c5a3a3689c08fe519ea6e12d61ab0380e7a0e683be4f7ed40992
Jul 31 00:56:30.984874 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.984841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq" event={"ID":"90217b54-3634-4fad-974c-212c7eb46b3d","Type":"ContainerStarted","Data":"eb8aec90a977b1372e2059a9ef13070d688c9413a0a599ac8fc33569e749772d"}
Jul 31 00:56:30.985234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.984895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq" event={"ID":"90217b54-3634-4fad-974c-212c7eb46b3d","Type":"ContainerStarted","Data":"78362b5ec483c5a3a3689c08fe519ea6e12d61ab0380e7a0e683be4f7ed40992"}
Jul 31 00:56:30.985234 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:30.984919    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:31.001134 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:31.001091    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq" podStartSLOduration=1.573935009 podStartE2EDuration="2.00107703s" totalImagesPullingTime="427.142021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:56:30.999228367 +0000 UTC m=+3031.276471367" watchObservedRunningTime="2026-07-31 00:56:31.00107703 +0000 UTC m=+3031.278320018"
Jul 31 00:56:36.996383 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:36.996352    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 00:56:42.052266 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:42.052233    2582 generic.go:356] "Generic (PLEG): container finished" podID="baa3f757-c433-41ef-9746-b5ee37064266" containerID="d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8" exitCode=0
Jul 31 00:56:42.052681 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:42.052312    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" event={"ID":"baa3f757-c433-41ef-9746-b5ee37064266","Type":"ContainerDied","Data":"d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8"}
Jul 31 00:56:42.052764 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:42.052750    2582 scope.go:117] "RemoveContainer" containerID="d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8"
Jul 31 00:56:42.053808 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:42.053780    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:56:42.053881 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:42.053864    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:56:42.053930 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:42.053915    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 00:56:42.966100 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:42.966065    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:43.059848 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:43.059815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" event={"ID":"baa3f757-c433-41ef-9746-b5ee37064266","Type":"ContainerStarted","Data":"f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75"}
Jul 31 00:56:43.365191 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:43.365153    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:43.366255 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:43.366227    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 31 00:56:43.366362 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:43.366286    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 31 00:56:44.365704 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:44.365664    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 31 00:56:44.366107 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:44.365733    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 31 00:56:45.365710 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:45.365666    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 31 00:56:45.366114 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:45.365729    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 31 00:56:46.365723 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:46.365681    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 31 00:56:46.366112 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:46.365739    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 31 00:56:47.365824 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:47.365779    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 31 00:56:47.366287 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:47.365852    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 31 00:56:48.369519 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:48.369489    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:48.369929 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:48.369772    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:48.370473 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:48.370457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 00:56:58.301705 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.301667    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"]
Jul 31 00:56:58.305782 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.305761    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.308353 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.308334    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b32567-serving-cert\""
Jul 31 00:56:58.313183 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.313162    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"]
Jul 31 00:56:58.403415 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.403381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabc12f7-9d6f-461d-a338-4084855925be-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.403724 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.403703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kwcl\" (UniqueName: \"kubernetes.io/projected/aabc12f7-9d6f-461d-a338-4084855925be-kube-api-access-2kwcl\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.403887 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.403871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aabc12f7-9d6f-461d-a338-4084855925be-maas-api-tls\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.505191 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.505152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabc12f7-9d6f-461d-a338-4084855925be-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.505402 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.505243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kwcl\" (UniqueName: \"kubernetes.io/projected/aabc12f7-9d6f-461d-a338-4084855925be-kube-api-access-2kwcl\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.505402 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.505292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aabc12f7-9d6f-461d-a338-4084855925be-maas-api-tls\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.505867 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.505843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabc12f7-9d6f-461d-a338-4084855925be-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.507597 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.507577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aabc12f7-9d6f-461d-a338-4084855925be-maas-api-tls\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.518511 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.518486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kwcl\" (UniqueName: \"kubernetes.io/projected/aabc12f7-9d6f-461d-a338-4084855925be-kube-api-access-2kwcl\") pod \"maas-api-e2e-shared-b-b32567-fdc94b754-7swc8\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.618320 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.618232    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:56:58.754505 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:58.754477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"]
Jul 31 00:56:58.758494 ip-10-0-143-7 kubenswrapper[2582]: W0731 00:56:58.758466    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabc12f7_9d6f_461d_a338_4084855925be.slice/crio-fced6a692b0498701585873bae11ad785780e12050aafbfeb7c1ec868b5feff1 WatchSource:0}: Error finding container fced6a692b0498701585873bae11ad785780e12050aafbfeb7c1ec868b5feff1: Status 404 returned error can't find the container with id fced6a692b0498701585873bae11ad785780e12050aafbfeb7c1ec868b5feff1
Jul 31 00:56:59.149715 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:56:59.149671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8" event={"ID":"aabc12f7-9d6f-461d-a338-4084855925be","Type":"ContainerStarted","Data":"fced6a692b0498701585873bae11ad785780e12050aafbfeb7c1ec868b5feff1"}
Jul 31 00:57:00.156933 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:57:00.156894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8" event={"ID":"aabc12f7-9d6f-461d-a338-4084855925be","Type":"ContainerStarted","Data":"963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a"}
Jul 31 00:57:00.157358 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:57:00.156986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 00:57:00.173717 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:57:00.173669    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8" podStartSLOduration=1.629957082 podStartE2EDuration="2.1736547s" totalImagesPullingTime="543.697618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 00:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 00:57:00.173070941 +0000 UTC m=+3060.450313941" watchObservedRunningTime="2026-07-31 00:57:00.1736547 +0000 UTC m=+3060.450897689"
Jul 31 00:57:06.168062 ip-10-0-143-7 kubenswrapper[2582]: I0731 00:57:06.168034    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 01:01:00.538263 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:01:00.538237    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 01:01:00.545442 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:01:00.545422    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 01:01:00.552075 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:01:00.552059    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 01:01:00.558517 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:01:00.558496    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 01:06:00.579032 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:00.579004    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 01:06:00.586486 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:00.586461    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 01:06:00.589494 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:00.589472    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 01:06:00.596407 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:00.596387    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 01:06:37.234580 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.234545    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"]
Jul 31 01:06:37.238225 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.238207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.241103 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.241084    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-2b1008-openshift-default-dockercfg-jtc42\""
Jul 31 01:06:37.249916 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.249895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"]
Jul 31 01:06:37.363377 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-data\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363377 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-certs\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363652 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-podinfo\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363652 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-envoy\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363737 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpsnz\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-kube-api-access-bpsnz\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363737 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-socket\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363737 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-credential-socket\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363834 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-token\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.363872 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.363840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istiod-ca-cert\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464495 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-credential-socket\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464683 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-token\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464683 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istiod-ca-cert\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464683 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-data\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464683 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-certs\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464683 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-podinfo\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464990 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-envoy\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464990 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpsnz\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-kube-api-access-bpsnz\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464990 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-socket\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.464990 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.464934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-credential-socket\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.465213 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.465039    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-data\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.465270 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.465232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-socket\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.465339 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.465267    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-certs\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.465398 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.465359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istiod-ca-cert\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.467017 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.466996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-envoy\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.467261 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.467242    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-podinfo\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.472158 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.472135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpsnz\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-kube-api-access-bpsnz\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.472440 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.472422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-token\") pod \"e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") " pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.550538 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.550506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:37.688104 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.688078    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"]
Jul 31 01:06:37.689938 ip-10-0-143-7 kubenswrapper[2582]: W0731 01:06:37.689910    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8f782d_7524_4bf0_aa92_20d4b16ee40c.slice/crio-8b32a32d297da8a0795142d812ef354696d966ed0985f0a2309d713de8fc3393 WatchSource:0}: Error finding container 8b32a32d297da8a0795142d812ef354696d966ed0985f0a2309d713de8fc3393: Status 404 returned error can't find the container with id 8b32a32d297da8a0795142d812ef354696d966ed0985f0a2309d713de8fc3393
Jul 31 01:06:37.692238 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.692207    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:06:37.692320 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.692280    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:06:37.692320 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:37.692309    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:06:38.337096 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:38.337052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" event={"ID":"db8f782d-7524-4bf0-aa92-20d4b16ee40c","Type":"ContainerStarted","Data":"b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50"}
Jul 31 01:06:38.337580 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:38.337110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" event={"ID":"db8f782d-7524-4bf0-aa92-20d4b16ee40c","Type":"ContainerStarted","Data":"8b32a32d297da8a0795142d812ef354696d966ed0985f0a2309d713de8fc3393"}
Jul 31 01:06:38.358677 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:38.358612    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podStartSLOduration=1.358597851 podStartE2EDuration="1.358597851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:06:38.356506039 +0000 UTC m=+3638.633749029" watchObservedRunningTime="2026-07-31 01:06:38.358597851 +0000 UTC m=+3638.635840840"
Jul 31 01:06:38.551284 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:38.551248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:38.556364 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:38.556341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:39.342849 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:39.342817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:39.343911 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:39.343889    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:41.401183 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.401145    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"]
Jul 31 01:06:41.404960 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.404938    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.407501 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.407485    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-2b1008-serving-cert\""
Jul 31 01:06:41.415546 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.415522    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"]
Jul 31 01:06:41.513383 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.513349    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca1bbdd-72ab-4052-9387-bd7778b91d58-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.513570 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.513411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca1bbdd-72ab-4052-9387-bd7778b91d58-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.513680 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.513575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlp4k\" (UniqueName: \"kubernetes.io/projected/bca1bbdd-72ab-4052-9387-bd7778b91d58-kube-api-access-xlp4k\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.614990 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.614947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca1bbdd-72ab-4052-9387-bd7778b91d58-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.615196 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.615011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca1bbdd-72ab-4052-9387-bd7778b91d58-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.615196 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.615082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlp4k\" (UniqueName: \"kubernetes.io/projected/bca1bbdd-72ab-4052-9387-bd7778b91d58-kube-api-access-xlp4k\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.615603 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.615584    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca1bbdd-72ab-4052-9387-bd7778b91d58-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.617505 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.617485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca1bbdd-72ab-4052-9387-bd7778b91d58-maas-api-tls\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.623214 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.623187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlp4k\" (UniqueName: \"kubernetes.io/projected/bca1bbdd-72ab-4052-9387-bd7778b91d58-kube-api-access-xlp4k\") pod \"maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.716798 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.716699    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:41.856042 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.856010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"]
Jul 31 01:06:41.857609 ip-10-0-143-7 kubenswrapper[2582]: W0731 01:06:41.857582    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca1bbdd_72ab_4052_9387_bd7778b91d58.slice/crio-c819505e52c18a1f63128b833cdf11bcbb33e7073c7c2714f1bf4fbf2b6e4bd4 WatchSource:0}: Error finding container c819505e52c18a1f63128b833cdf11bcbb33e7073c7c2714f1bf4fbf2b6e4bd4: Status 404 returned error can't find the container with id c819505e52c18a1f63128b833cdf11bcbb33e7073c7c2714f1bf4fbf2b6e4bd4
Jul 31 01:06:41.859051 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:41.859030    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:06:42.359562 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:42.359525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb" event={"ID":"bca1bbdd-72ab-4052-9387-bd7778b91d58","Type":"ContainerStarted","Data":"c819505e52c18a1f63128b833cdf11bcbb33e7073c7c2714f1bf4fbf2b6e4bd4"}
Jul 31 01:06:43.372955 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:43.372920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb" event={"ID":"bca1bbdd-72ab-4052-9387-bd7778b91d58","Type":"ContainerStarted","Data":"ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3"}
Jul 31 01:06:43.373343 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:43.373020    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:43.388711 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:43.388670    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb" podStartSLOduration=1.724359063 podStartE2EDuration="2.388657384s" totalImagesPullingTime="664.298321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:06:43.387260546 +0000 UTC m=+3643.664503537" watchObservedRunningTime="2026-07-31 01:06:43.388657384 +0000 UTC m=+3643.665900373"
Jul 31 01:06:49.383560 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:49.383529    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:06:54.344256 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.344219    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 31 01:06:54.344684 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.344291    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 31 01:06:54.441316 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.441275    2582 generic.go:356] "Generic (PLEG): container finished" podID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerID="b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50" exitCode=0
Jul 31 01:06:54.441485 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.441349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" event={"ID":"db8f782d-7524-4bf0-aa92-20d4b16ee40c","Type":"ContainerDied","Data":"b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50"}
Jul 31 01:06:54.441799 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.441784    2582 scope.go:117] "RemoveContainer" containerID="b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50"
Jul 31 01:06:54.442806 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.442781    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:06:54.442868 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.442845    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:06:54.442915 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:54.442878    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:06:55.452047 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:55.452008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" event={"ID":"db8f782d-7524-4bf0-aa92-20d4b16ee40c","Type":"ContainerStarted","Data":"f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb"}
Jul 31 01:06:55.551662 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:55.551597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:06:55.551845 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:55.551825    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 31 01:06:55.551893 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:55.551870    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 31 01:06:56.551687 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:56.551617    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 31 01:06:56.552100 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:56.551708    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 31 01:06:57.550991 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:57.550949    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 31 01:06:57.551199 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:57.551017    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 31 01:06:58.551231 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:58.551189    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 31 01:06:58.551658 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:58.551248    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 31 01:06:59.551634 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:59.551583    2582 patch_prober.go:28] interesting pod/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 31 01:06:59.552058 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:06:59.551675    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 31 01:07:00.555747 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:00.555710    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:07:00.556140 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:00.556012    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:07:00.556787 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:00.556767    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:07:10.453099 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.453060    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"]
Jul 31 01:07:10.458562 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.458536    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.461329 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.461297    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-0f1466-serving-cert\""
Jul 31 01:07:10.464335 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.464310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"]
Jul 31 01:07:10.605386 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.605346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.605565 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.605398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.605565 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.605483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5jv6\" (UniqueName: \"kubernetes.io/projected/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-kube-api-access-v5jv6\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.706086 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.705996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.706086 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.706047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.706265 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.706094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5jv6\" (UniqueName: \"kubernetes.io/projected/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-kube-api-access-v5jv6\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.706664 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.706637    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.708486 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.708464    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.715150 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.715121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5jv6\" (UniqueName: \"kubernetes.io/projected/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-kube-api-access-v5jv6\") pod \"maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.771897 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.771871    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:10.908727 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:10.908694    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"]
Jul 31 01:07:10.909434 ip-10-0-143-7 kubenswrapper[2582]: W0731 01:07:10.909406    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cf1133_5032_418d_aaa2_e5b2352e6c6f.slice/crio-94d805fad378677bb902f45a4d30283ddbcc13cc1c32b3279bf82d872db561f0 WatchSource:0}: Error finding container 94d805fad378677bb902f45a4d30283ddbcc13cc1c32b3279bf82d872db561f0: Status 404 returned error can't find the container with id 94d805fad378677bb902f45a4d30283ddbcc13cc1c32b3279bf82d872db561f0
Jul 31 01:07:11.543792 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:11.543756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck" event={"ID":"a8cf1133-5032-418d-aaa2-e5b2352e6c6f","Type":"ContainerStarted","Data":"94d805fad378677bb902f45a4d30283ddbcc13cc1c32b3279bf82d872db561f0"}
Jul 31 01:07:12.550606 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:12.550573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck" event={"ID":"a8cf1133-5032-418d-aaa2-e5b2352e6c6f","Type":"ContainerStarted","Data":"7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e"}
Jul 31 01:07:12.551041 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:12.550772    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:07:12.569347 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:12.569304    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck" podStartSLOduration=1.962239877 podStartE2EDuration="2.569289616s" totalImagesPullingTime="607.049739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:07:12.565532706 +0000 UTC m=+3672.842775695" watchObservedRunningTime="2026-07-31 01:07:12.569289616 +0000 UTC m=+3672.846532605"
Jul 31 01:07:18.561897 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:07:18.561868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:08:32.179425 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.179389    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"]
Jul 31 01:08:32.183215 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.183194    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.186166 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.186142    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-689edf-openshift-default-dockercfg-qgtf6\""
Jul 31 01:08:32.194912 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.194892    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"]
Jul 31 01:08:32.271642 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-data\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.271840 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-socket\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.271840 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-credential-socket\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.271840 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-token\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.271840 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f89ds\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-kube-api-access-f89ds\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.272079 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-envoy\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.272079 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istiod-ca-cert\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.272079 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.271993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-podinfo\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.272079 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.272017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-certs\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372680 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istiod-ca-cert\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-podinfo\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-certs\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-data\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-socket\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-credential-socket\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-token\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.372877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f89ds\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-kube-api-access-f89ds\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.373349 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.372888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-envoy\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.373349 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.373294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-certs\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.373447 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.373347    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-data\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.373447 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.373375    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-credential-socket\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.373447 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.373399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-socket\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.373618 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.373595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istiod-ca-cert\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.375316 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.375292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-envoy\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.375422 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.375378    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-podinfo\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.380409 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.380381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-token\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.380963 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.380946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f89ds\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-kube-api-access-f89ds\") pod \"e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") " pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.495845 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.495758    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:32.633261 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.633238    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"]
Jul 31 01:08:32.635656 ip-10-0-143-7 kubenswrapper[2582]: W0731 01:08:32.635605    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d01a46_30b7_4a21_a2ac_8e2bfd473c68.slice/crio-289d7a2950cf6294564d66d13075027a74daa23215eeec3d20f31b463b7e9276 WatchSource:0}: Error finding container 289d7a2950cf6294564d66d13075027a74daa23215eeec3d20f31b463b7e9276: Status 404 returned error can't find the container with id 289d7a2950cf6294564d66d13075027a74daa23215eeec3d20f31b463b7e9276
Jul 31 01:08:32.638129 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.638098    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:08:32.638206 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.638159    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:08:32.638206 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.638186    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:08:32.993461 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.993419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" event={"ID":"55d01a46-30b7-4a21-a2ac-8e2bfd473c68","Type":"ContainerStarted","Data":"ba37a388d366866312a4ddb5f9998926da2c3ab755785a09b4035c7cba930c7c"}
Jul 31 01:08:32.993679 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:32.993477    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" event={"ID":"55d01a46-30b7-4a21-a2ac-8e2bfd473c68","Type":"ContainerStarted","Data":"289d7a2950cf6294564d66d13075027a74daa23215eeec3d20f31b463b7e9276"}
Jul 31 01:08:33.013395 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:33.013341    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podStartSLOduration=1.013325178 podStartE2EDuration="1.013325178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:08:33.012903804 +0000 UTC m=+3753.290146795" watchObservedRunningTime="2026-07-31 01:08:33.013325178 +0000 UTC m=+3753.290568158"
Jul 31 01:08:33.496083 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:33.496046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:33.501127 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:33.501101    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:33.999584 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:33.999554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:34.000460 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:34.000439    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:49.623406 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:49.623370    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:40844->10.132.0.68:15021: read: connection reset by peer" start-of-body=
Jul 31 01:08:49.623907 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:49.623454    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:40844->10.132.0.68:15021: read: connection reset by peer"
Jul 31 01:08:50.113418 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:50.113386    2582 generic.go:356] "Generic (PLEG): container finished" podID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerID="ba37a388d366866312a4ddb5f9998926da2c3ab755785a09b4035c7cba930c7c" exitCode=0
Jul 31 01:08:50.113583 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:50.113458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" event={"ID":"55d01a46-30b7-4a21-a2ac-8e2bfd473c68","Type":"ContainerDied","Data":"ba37a388d366866312a4ddb5f9998926da2c3ab755785a09b4035c7cba930c7c"}
Jul 31 01:08:50.113873 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:50.113859    2582 scope.go:117] "RemoveContainer" containerID="ba37a388d366866312a4ddb5f9998926da2c3ab755785a09b4035c7cba930c7c"
Jul 31 01:08:50.114965 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:50.114941    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:08:50.115032 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:50.115002    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:08:50.115068 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:50.115031    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 01:08:51.120827 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:51.120740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" event={"ID":"55d01a46-30b7-4a21-a2ac-8e2bfd473c68","Type":"ContainerStarted","Data":"b8e83deecd0d8fe2b38e5201b49037d5913bd0d6a2ff92679147272afaa30062"}
Jul 31 01:08:51.495970 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:51.495890    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:51.496117 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:51.496033    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 31 01:08:51.496117 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:51.496078    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 31 01:08:52.496125 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:52.496037    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 31 01:08:52.496125 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:52.496106    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 31 01:08:53.496915 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:53.496878    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 31 01:08:53.497312 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:53.496936    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 31 01:08:54.496386 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:54.496342    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 31 01:08:54.496571 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:54.496407    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 31 01:08:55.496929 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:55.496893    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 31 01:08:55.497337 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:55.496958    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 31 01:08:56.499806 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:56.499776    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:56.500168 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:56.500022    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:08:56.500597 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:08:56.500582    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:09:13.165873 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:13.165832    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"]
Jul 31 01:09:13.166407 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:13.166112    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy" containerID="cri-o://b8e83deecd0d8fe2b38e5201b49037d5913bd0d6a2ff92679147272afaa30062" gracePeriod=30
Jul 31 01:09:18.299099 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.299068    2582 generic.go:356] "Generic (PLEG): container finished" podID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerID="b8e83deecd0d8fe2b38e5201b49037d5913bd0d6a2ff92679147272afaa30062" exitCode=0
Jul 31 01:09:18.299483 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.299141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" event={"ID":"55d01a46-30b7-4a21-a2ac-8e2bfd473c68","Type":"ContainerDied","Data":"b8e83deecd0d8fe2b38e5201b49037d5913bd0d6a2ff92679147272afaa30062"}
Jul 31 01:09:18.299483 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.299205    2582 scope.go:117] "RemoveContainer" containerID="ba37a388d366866312a4ddb5f9998926da2c3ab755785a09b4035c7cba930c7c"
Jul 31 01:09:18.427697 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.427672    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:09:18.505122 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505097    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istiod-ca-cert\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505290 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505157    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-podinfo\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505290 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505192    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-token\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505290 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505228    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-certs\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505290 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-socket\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505519 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505355    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f89ds\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-kube-api-access-f89ds\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505519 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505399    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-data\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505519 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505484    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-envoy\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505714 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505526    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-credential-socket\") pod \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\" (UID: \"55d01a46-30b7-4a21-a2ac-8e2bfd473c68\") "
Jul 31 01:09:18.505714 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505560    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:09:18.505714 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505576    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:09:18.505714 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505593    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:18.505922 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505817    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-data" (OuterVolumeSpecName: "istio-data") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:09:18.505922 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.505830    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:09:18.506045 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.506024    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.506104 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.506048    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.506104 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.506062    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.506104 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.506074    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.506104 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.506086    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.507551 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.507521    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 01:09:18.507551 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.507521    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-kube-api-access-f89ds" (OuterVolumeSpecName: "kube-api-access-f89ds") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "kube-api-access-f89ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:18.507736 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.507560    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:09:18.507736 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.507601    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-token" (OuterVolumeSpecName: "istio-token") pod "55d01a46-30b7-4a21-a2ac-8e2bfd473c68" (UID: "55d01a46-30b7-4a21-a2ac-8e2bfd473c68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:18.606782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.606738    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.606782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.606778    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.606782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.606789    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f89ds\" (UniqueName: \"kubernetes.io/projected/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-kube-api-access-f89ds\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:18.606782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:18.606799    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d01a46-30b7-4a21-a2ac-8e2bfd473c68-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:19.306779 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:19.306741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m" event={"ID":"55d01a46-30b7-4a21-a2ac-8e2bfd473c68","Type":"ContainerDied","Data":"289d7a2950cf6294564d66d13075027a74daa23215eeec3d20f31b463b7e9276"}
Jul 31 01:09:19.306779 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:19.306760    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"
Jul 31 01:09:19.307278 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:19.306806    2582 scope.go:117] "RemoveContainer" containerID="b8e83deecd0d8fe2b38e5201b49037d5913bd0d6a2ff92679147272afaa30062"
Jul 31 01:09:19.329506 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:19.329470    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"]
Jul 31 01:09:19.332364 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:19.332338    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-689edf-openshift-default-84998db656-2lx5m"]
Jul 31 01:09:20.248976 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:20.248944    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" path="/var/lib/kubelet/pods/55d01a46-30b7-4a21-a2ac-8e2bfd473c68/volumes"
Jul 31 01:09:32.499751 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.499717    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"]
Jul 31 01:09:32.500227 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.500005    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb" podUID="bca1bbdd-72ab-4052-9387-bd7778b91d58" containerName="maas-api" containerID="cri-o://ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3" gracePeriod=30
Jul 31 01:09:32.777649 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.777607    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:09:32.952975 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.952942    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca1bbdd-72ab-4052-9387-bd7778b91d58-openshift-service-ca\") pod \"bca1bbdd-72ab-4052-9387-bd7778b91d58\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") "
Jul 31 01:09:32.953152 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.952994    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlp4k\" (UniqueName: \"kubernetes.io/projected/bca1bbdd-72ab-4052-9387-bd7778b91d58-kube-api-access-xlp4k\") pod \"bca1bbdd-72ab-4052-9387-bd7778b91d58\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") "
Jul 31 01:09:32.953152 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.953041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca1bbdd-72ab-4052-9387-bd7778b91d58-maas-api-tls\") pod \"bca1bbdd-72ab-4052-9387-bd7778b91d58\" (UID: \"bca1bbdd-72ab-4052-9387-bd7778b91d58\") "
Jul 31 01:09:32.953358 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.953334    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bca1bbdd-72ab-4052-9387-bd7778b91d58-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bca1bbdd-72ab-4052-9387-bd7778b91d58" (UID: "bca1bbdd-72ab-4052-9387-bd7778b91d58"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:09:32.955192 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.955167    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bca1bbdd-72ab-4052-9387-bd7778b91d58-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bca1bbdd-72ab-4052-9387-bd7778b91d58" (UID: "bca1bbdd-72ab-4052-9387-bd7778b91d58"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:09:32.955302 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:32.955256    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca1bbdd-72ab-4052-9387-bd7778b91d58-kube-api-access-xlp4k" (OuterVolumeSpecName: "kube-api-access-xlp4k") pod "bca1bbdd-72ab-4052-9387-bd7778b91d58" (UID: "bca1bbdd-72ab-4052-9387-bd7778b91d58"). InnerVolumeSpecName "kube-api-access-xlp4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:09:33.054026 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.053943    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bca1bbdd-72ab-4052-9387-bd7778b91d58-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:33.054026 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.053972    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bca1bbdd-72ab-4052-9387-bd7778b91d58-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:33.054026 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.053986    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlp4k\" (UniqueName: \"kubernetes.io/projected/bca1bbdd-72ab-4052-9387-bd7778b91d58-kube-api-access-xlp4k\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:09:33.396063 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.395977    2582 generic.go:356] "Generic (PLEG): container finished" podID="bca1bbdd-72ab-4052-9387-bd7778b91d58" containerID="ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3" exitCode=0
Jul 31 01:09:33.396063 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.396020    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"
Jul 31 01:09:33.396263 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.396057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb" event={"ID":"bca1bbdd-72ab-4052-9387-bd7778b91d58","Type":"ContainerDied","Data":"ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3"}
Jul 31 01:09:33.396263 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.396112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb" event={"ID":"bca1bbdd-72ab-4052-9387-bd7778b91d58","Type":"ContainerDied","Data":"c819505e52c18a1f63128b833cdf11bcbb33e7073c7c2714f1bf4fbf2b6e4bd4"}
Jul 31 01:09:33.396263 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.396135    2582 scope.go:117] "RemoveContainer" containerID="ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3"
Jul 31 01:09:33.405765 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.405747    2582 scope.go:117] "RemoveContainer" containerID="ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3"
Jul 31 01:09:33.406027 ip-10-0-143-7 kubenswrapper[2582]: E0731 01:09:33.406008    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3\": container with ID starting with ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3 not found: ID does not exist" containerID="ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3"
Jul 31 01:09:33.406091 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.406035    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3"} err="failed to get container status \"ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3\": rpc error: code = NotFound desc = could not find container \"ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3\": container with ID starting with ef1a509fff032fce2d53091804c6df9af71c9c542c805fe00454c2fa32461ed3 not found: ID does not exist"
Jul 31 01:09:33.417330 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.417309    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"]
Jul 31 01:09:33.422595 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:33.422574    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-2b1008-649fc4d6ff-z67zb"]
Jul 31 01:09:34.248481 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:09:34.248447    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca1bbdd-72ab-4052-9387-bd7778b91d58" path="/var/lib/kubelet/pods/bca1bbdd-72ab-4052-9387-bd7778b91d58/volumes"
Jul 31 01:10:34.677181 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:34.677098    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"]
Jul 31 01:10:34.677748 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:34.677333    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy" containerID="cri-o://f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb" gracePeriod=30
Jul 31 01:10:39.932586 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:39.932558    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:10:40.096571 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096538    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-data\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.096571 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096577    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-credential-socket\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.096813 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-envoy\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.096813 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096653    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istiod-ca-cert\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.096813 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096765    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-socket\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.096813 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096792    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-podinfo\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.097030 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096823    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpsnz\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-kube-api-access-bpsnz\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.097030 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096851    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-token\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.097030 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:10:40.097030 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096909    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-certs\") pod \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\" (UID: \"db8f782d-7524-4bf0-aa92-20d4b16ee40c\") "
Jul 31 01:10:40.097250 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.096903    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-data" (OuterVolumeSpecName: "istio-data") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:10:40.097250 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097194    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:10:40.097250 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:10:40.097250 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097116    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:10:40.097468 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097313    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.097468 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097333    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.097468 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097349    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.097468 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097363    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.097468 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.097375    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.098925 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.098896    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 01:10:40.099039 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.098952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-kube-api-access-bpsnz" (OuterVolumeSpecName: "kube-api-access-bpsnz") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "kube-api-access-bpsnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:10:40.099203 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.099187    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:10:40.099285 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.099268    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-token" (OuterVolumeSpecName: "istio-token") pod "db8f782d-7524-4bf0-aa92-20d4b16ee40c" (UID: "db8f782d-7524-4bf0-aa92-20d4b16ee40c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:10:40.198217 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.198190    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.198217 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.198213    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.198217 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.198224    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpsnz\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-kube-api-access-bpsnz\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.198444 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.198233    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db8f782d-7524-4bf0-aa92-20d4b16ee40c-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:40.786706 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.786673    2582 generic.go:356] "Generic (PLEG): container finished" podID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerID="f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb" exitCode=0
Jul 31 01:10:40.786897 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.786720    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"
Jul 31 01:10:40.786897 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.786759    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" event={"ID":"db8f782d-7524-4bf0-aa92-20d4b16ee40c","Type":"ContainerDied","Data":"f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb"}
Jul 31 01:10:40.786897 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.786826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7" event={"ID":"db8f782d-7524-4bf0-aa92-20d4b16ee40c","Type":"ContainerDied","Data":"8b32a32d297da8a0795142d812ef354696d966ed0985f0a2309d713de8fc3393"}
Jul 31 01:10:40.786897 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.786856    2582 scope.go:117] "RemoveContainer" containerID="f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb"
Jul 31 01:10:40.799075 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.798890    2582 scope.go:117] "RemoveContainer" containerID="b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50"
Jul 31 01:10:40.807453 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.807436    2582 scope.go:117] "RemoveContainer" containerID="f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb"
Jul 31 01:10:40.807752 ip-10-0-143-7 kubenswrapper[2582]: E0731 01:10:40.807732    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb\": container with ID starting with f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb not found: ID does not exist" containerID="f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb"
Jul 31 01:10:40.807799 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.807761    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb"} err="failed to get container status \"f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb\": rpc error: code = NotFound desc = could not find container \"f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb\": container with ID starting with f00dd8fc64e95459975296437232c94cbc0fb85cfa33f66b21466ac6aae7fecb not found: ID does not exist"
Jul 31 01:10:40.807799 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.807782    2582 scope.go:117] "RemoveContainer" containerID="b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50"
Jul 31 01:10:40.807864 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.807766    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"]
Jul 31 01:10:40.808052 ip-10-0-143-7 kubenswrapper[2582]: E0731 01:10:40.808036    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50\": container with ID starting with b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50 not found: ID does not exist" containerID="b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50"
Jul 31 01:10:40.808101 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.808060    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50"} err="failed to get container status \"b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50\": rpc error: code = NotFound desc = could not find container \"b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50\": container with ID starting with b9cc718aa4f3937a7537ae555003b9b871d6308e39de38f47523ddddc2e45b50 not found: ID does not exist"
Jul 31 01:10:40.812793 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:40.812772    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-2b1008-openshift-default-5ff6676748-s9cb7"]
Jul 31 01:10:42.248398 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:42.248360    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" path="/var/lib/kubelet/pods/db8f782d-7524-4bf0-aa92-20d4b16ee40c/volumes"
Jul 31 01:10:45.462459 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.462429    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"]
Jul 31 01:10:45.462880 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.462642    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck" podUID="a8cf1133-5032-418d-aaa2-e5b2352e6c6f" containerName="maas-api" containerID="cri-o://7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e" gracePeriod=30
Jul 31 01:10:45.725792 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.725741    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:10:45.824554 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.824520    2582 generic.go:356] "Generic (PLEG): container finished" podID="a8cf1133-5032-418d-aaa2-e5b2352e6c6f" containerID="7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e" exitCode=0
Jul 31 01:10:45.824744 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.824596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck" event={"ID":"a8cf1133-5032-418d-aaa2-e5b2352e6c6f","Type":"ContainerDied","Data":"7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e"}
Jul 31 01:10:45.824744 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.824641    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"
Jul 31 01:10:45.824744 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.824680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck" event={"ID":"a8cf1133-5032-418d-aaa2-e5b2352e6c6f","Type":"ContainerDied","Data":"94d805fad378677bb902f45a4d30283ddbcc13cc1c32b3279bf82d872db561f0"}
Jul 31 01:10:45.824744 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.824719    2582 scope.go:117] "RemoveContainer" containerID="7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e"
Jul 31 01:10:45.834733 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.834711    2582 scope.go:117] "RemoveContainer" containerID="7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e"
Jul 31 01:10:45.835006 ip-10-0-143-7 kubenswrapper[2582]: E0731 01:10:45.834986    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e\": container with ID starting with 7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e not found: ID does not exist" containerID="7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e"
Jul 31 01:10:45.835055 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.835014    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e"} err="failed to get container status \"7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e\": rpc error: code = NotFound desc = could not find container \"7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e\": container with ID starting with 7fba346bbd24d44c60372adbeadccf8b34ad9efdbfde4b4e4e0dd32281a42b6e not found: ID does not exist"
Jul 31 01:10:45.847368 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.847347    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5jv6\" (UniqueName: \"kubernetes.io/projected/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-kube-api-access-v5jv6\") pod \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") "
Jul 31 01:10:45.847465 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.847412    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-openshift-service-ca\") pod \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") "
Jul 31 01:10:45.847506 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.847480    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-maas-api-tls\") pod \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\" (UID: \"a8cf1133-5032-418d-aaa2-e5b2352e6c6f\") "
Jul 31 01:10:45.847725 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.847698    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8cf1133-5032-418d-aaa2-e5b2352e6c6f" (UID: "a8cf1133-5032-418d-aaa2-e5b2352e6c6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:10:45.849462 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.849429    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-kube-api-access-v5jv6" (OuterVolumeSpecName: "kube-api-access-v5jv6") pod "a8cf1133-5032-418d-aaa2-e5b2352e6c6f" (UID: "a8cf1133-5032-418d-aaa2-e5b2352e6c6f"). InnerVolumeSpecName "kube-api-access-v5jv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:10:45.849553 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.849504    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8cf1133-5032-418d-aaa2-e5b2352e6c6f" (UID: "a8cf1133-5032-418d-aaa2-e5b2352e6c6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:10:45.948369 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.948330    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5jv6\" (UniqueName: \"kubernetes.io/projected/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-kube-api-access-v5jv6\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:45.948369 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.948360    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:45.948369 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:45.948369    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8cf1133-5032-418d-aaa2-e5b2352e6c6f-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:10:46.148015 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:46.147978    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"]
Jul 31 01:10:46.151334 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:46.151308    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0f1466-76cb894f6b-89bck"]
Jul 31 01:10:46.248617 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:10:46.248585    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8cf1133-5032-418d-aaa2-e5b2352e6c6f" path="/var/lib/kubelet/pods/a8cf1133-5032-418d-aaa2-e5b2352e6c6f/volumes"
Jul 31 01:11:00.616134 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:00.616104    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 01:11:00.623088 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:00.623065    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 01:11:00.627334 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:00.627316    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 01:11:00.634131 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:00.634114    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8v42_34a4c6a5-75f1-4516-bc55-374e81a2d2aa/ovn-acl-logging/0.log"
Jul 31 01:11:02.789254 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:02.789205    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"]
Jul 31 01:11:02.789779 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:02.789467    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq" podUID="90217b54-3634-4fad-974c-212c7eb46b3d" containerName="maas-api" containerID="cri-o://eb8aec90a977b1372e2059a9ef13070d688c9413a0a599ac8fc33569e749772d" gracePeriod=30
Jul 31 01:11:02.923940 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:02.923906    2582 generic.go:356] "Generic (PLEG): container finished" podID="90217b54-3634-4fad-974c-212c7eb46b3d" containerID="eb8aec90a977b1372e2059a9ef13070d688c9413a0a599ac8fc33569e749772d" exitCode=0
Jul 31 01:11:02.924081 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:02.923970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq" event={"ID":"90217b54-3634-4fad-974c-212c7eb46b3d","Type":"ContainerDied","Data":"eb8aec90a977b1372e2059a9ef13070d688c9413a0a599ac8fc33569e749772d"}
Jul 31 01:11:03.050432 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.050369    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 01:11:03.096657 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.096595    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bmzr\" (UniqueName: \"kubernetes.io/projected/90217b54-3634-4fad-974c-212c7eb46b3d-kube-api-access-5bmzr\") pod \"90217b54-3634-4fad-974c-212c7eb46b3d\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") "
Jul 31 01:11:03.096657 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.096663    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90217b54-3634-4fad-974c-212c7eb46b3d-openshift-service-ca\") pod \"90217b54-3634-4fad-974c-212c7eb46b3d\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") "
Jul 31 01:11:03.096888 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.096785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90217b54-3634-4fad-974c-212c7eb46b3d-maas-api-tls\") pod \"90217b54-3634-4fad-974c-212c7eb46b3d\" (UID: \"90217b54-3634-4fad-974c-212c7eb46b3d\") "
Jul 31 01:11:03.097039 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.097014    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90217b54-3634-4fad-974c-212c7eb46b3d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90217b54-3634-4fad-974c-212c7eb46b3d" (UID: "90217b54-3634-4fad-974c-212c7eb46b3d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:03.098799 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.098766    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90217b54-3634-4fad-974c-212c7eb46b3d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90217b54-3634-4fad-974c-212c7eb46b3d" (UID: "90217b54-3634-4fad-974c-212c7eb46b3d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:11:03.098889 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.098845    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90217b54-3634-4fad-974c-212c7eb46b3d-kube-api-access-5bmzr" (OuterVolumeSpecName: "kube-api-access-5bmzr") pod "90217b54-3634-4fad-974c-212c7eb46b3d" (UID: "90217b54-3634-4fad-974c-212c7eb46b3d"). InnerVolumeSpecName "kube-api-access-5bmzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:03.198190 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.198130    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90217b54-3634-4fad-974c-212c7eb46b3d-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:03.198190 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.198180    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bmzr\" (UniqueName: \"kubernetes.io/projected/90217b54-3634-4fad-974c-212c7eb46b3d-kube-api-access-5bmzr\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:03.198190 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.198194    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90217b54-3634-4fad-974c-212c7eb46b3d-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:03.931164 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.931136    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"
Jul 31 01:11:03.931549 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.931137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq" event={"ID":"90217b54-3634-4fad-974c-212c7eb46b3d","Type":"ContainerDied","Data":"78362b5ec483c5a3a3689c08fe519ea6e12d61ab0380e7a0e683be4f7ed40992"}
Jul 31 01:11:03.931549 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.931277    2582 scope.go:117] "RemoveContainer" containerID="eb8aec90a977b1372e2059a9ef13070d688c9413a0a599ac8fc33569e749772d"
Jul 31 01:11:03.953591 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.953557    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"]
Jul 31 01:11:03.956392 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:03.956371    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6a2164-84d69cd6b-k7rfq"]
Jul 31 01:11:04.248333 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:04.248253    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90217b54-3634-4fad-974c-212c7eb46b3d" path="/var/lib/kubelet/pods/90217b54-3634-4fad-974c-212c7eb46b3d/volumes"
Jul 31 01:11:09.486793 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:09.486755    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"]
Jul 31 01:11:09.487426 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:09.487034    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy" containerID="cri-o://f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75" gracePeriod=30
Jul 31 01:11:14.731505 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.731479    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 01:11:14.803879 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.803850    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg4k8\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-kube-api-access-cg4k8\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804076 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.803914    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-certs\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804076 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.803962    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-socket\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804076 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.803984    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-credential-socket\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804076 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804016    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-envoy\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804076 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804070    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa3f757-c433-41ef-9746-b5ee37064266-istiod-ca-cert\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804357 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-istio-token\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804357 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804166    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa3f757-c433-41ef-9746-b5ee37064266-istio-podinfo\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804357 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804208    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-data\") pod \"baa3f757-c433-41ef-9746-b5ee37064266\" (UID: \"baa3f757-c433-41ef-9746-b5ee37064266\") "
Jul 31 01:11:14.804357 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804248    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:11:14.804357 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804273    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:11:14.804357 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:11:14.804669 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804502    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa3f757-c433-41ef-9746-b5ee37064266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:14.804669 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804515    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-data" (OuterVolumeSpecName: "istio-data") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:11:14.804669 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804636    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-data\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.804669 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804653    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-certs\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.804669 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804666    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-workload-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.804937 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804678    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-credential-socket\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.804937 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.804690    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa3f757-c433-41ef-9746-b5ee37064266-istiod-ca-cert\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.806189 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.806162    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-kube-api-access-cg4k8" (OuterVolumeSpecName: "kube-api-access-cg4k8") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "kube-api-access-cg4k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:14.806299 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.806280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/baa3f757-c433-41ef-9746-b5ee37064266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 01:11:14.806377 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.806363    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-istio-token" (OuterVolumeSpecName: "istio-token") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:14.806377 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.806364    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "baa3f757-c433-41ef-9746-b5ee37064266" (UID: "baa3f757-c433-41ef-9746-b5ee37064266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:11:14.906245 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.906213    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa3f757-c433-41ef-9746-b5ee37064266-istio-podinfo\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.906245 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.906243    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg4k8\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-kube-api-access-cg4k8\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.906245 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.906252    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa3f757-c433-41ef-9746-b5ee37064266-istio-envoy\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.906497 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.906260    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa3f757-c433-41ef-9746-b5ee37064266-istio-token\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:14.995480 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.995449    2582 generic.go:356] "Generic (PLEG): container finished" podID="baa3f757-c433-41ef-9746-b5ee37064266" containerID="f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75" exitCode=0
Jul 31 01:11:14.995660 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.995513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" event={"ID":"baa3f757-c433-41ef-9746-b5ee37064266","Type":"ContainerDied","Data":"f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75"}
Jul 31 01:11:14.995660 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.995556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2" event={"ID":"baa3f757-c433-41ef-9746-b5ee37064266","Type":"ContainerDied","Data":"ef9f45356b89ee25905772f9410898df8d2c280b9fbca5f4045ac3b274f02628"}
Jul 31 01:11:14.995660 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.995580    2582 scope.go:117] "RemoveContainer" containerID="f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75"
Jul 31 01:11:14.995660 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:14.995515    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"
Jul 31 01:11:15.005648 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:15.005610    2582 scope.go:117] "RemoveContainer" containerID="d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8"
Jul 31 01:11:15.013638 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:15.013609    2582 scope.go:117] "RemoveContainer" containerID="f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75"
Jul 31 01:11:15.013886 ip-10-0-143-7 kubenswrapper[2582]: E0731 01:11:15.013868    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75\": container with ID starting with f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75 not found: ID does not exist" containerID="f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75"
Jul 31 01:11:15.013989 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:15.013893    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75"} err="failed to get container status \"f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75\": rpc error: code = NotFound desc = could not find container \"f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75\": container with ID starting with f1e164e6a2b1c758ea99e872f2501f094c886c3ddde1af5b598333bad9896b75 not found: ID does not exist"
Jul 31 01:11:15.013989 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:15.013912    2582 scope.go:117] "RemoveContainer" containerID="d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8"
Jul 31 01:11:15.014156 ip-10-0-143-7 kubenswrapper[2582]: E0731 01:11:15.014135    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8\": container with ID starting with d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8 not found: ID does not exist" containerID="d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8"
Jul 31 01:11:15.014211 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:15.014164    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8"} err="failed to get container status \"d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8\": rpc error: code = NotFound desc = could not find container \"d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8\": container with ID starting with d97cd8d656b86de20311c808b1b553951ab4706593cfe0ba0798bc1329a89bc8 not found: ID does not exist"
Jul 31 01:11:15.017569 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:15.017546    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"]
Jul 31 01:11:15.021152 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:15.021130    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2164-openshift-default-7984477588-7pbq2"]
Jul 31 01:11:16.248197 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:16.248163    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa3f757-c433-41ef-9746-b5ee37064266" path="/var/lib/kubelet/pods/baa3f757-c433-41ef-9746-b5ee37064266/volumes"
Jul 31 01:11:20.271085 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.271049    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"]
Jul 31 01:11:20.271539 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.271255    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8" podUID="aabc12f7-9d6f-461d-a338-4084855925be" containerName="maas-api" containerID="cri-o://963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a" gracePeriod=30
Jul 31 01:11:20.517711 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.517684    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 01:11:20.656160 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.656086    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kwcl\" (UniqueName: \"kubernetes.io/projected/aabc12f7-9d6f-461d-a338-4084855925be-kube-api-access-2kwcl\") pod \"aabc12f7-9d6f-461d-a338-4084855925be\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") "
Jul 31 01:11:20.656160 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.656140    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabc12f7-9d6f-461d-a338-4084855925be-openshift-service-ca\") pod \"aabc12f7-9d6f-461d-a338-4084855925be\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") "
Jul 31 01:11:20.656337 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.656226    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aabc12f7-9d6f-461d-a338-4084855925be-maas-api-tls\") pod \"aabc12f7-9d6f-461d-a338-4084855925be\" (UID: \"aabc12f7-9d6f-461d-a338-4084855925be\") "
Jul 31 01:11:20.656617 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.656584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aabc12f7-9d6f-461d-a338-4084855925be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aabc12f7-9d6f-461d-a338-4084855925be" (UID: "aabc12f7-9d6f-461d-a338-4084855925be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:11:20.658214 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.658186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aabc12f7-9d6f-461d-a338-4084855925be-kube-api-access-2kwcl" (OuterVolumeSpecName: "kube-api-access-2kwcl") pod "aabc12f7-9d6f-461d-a338-4084855925be" (UID: "aabc12f7-9d6f-461d-a338-4084855925be"). InnerVolumeSpecName "kube-api-access-2kwcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:11:20.658316 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.658295    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aabc12f7-9d6f-461d-a338-4084855925be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aabc12f7-9d6f-461d-a338-4084855925be" (UID: "aabc12f7-9d6f-461d-a338-4084855925be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:11:20.757667 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.757645    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aabc12f7-9d6f-461d-a338-4084855925be-maas-api-tls\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:20.757667 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.757667    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kwcl\" (UniqueName: \"kubernetes.io/projected/aabc12f7-9d6f-461d-a338-4084855925be-kube-api-access-2kwcl\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:20.757829 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:20.757677    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabc12f7-9d6f-461d-a338-4084855925be-openshift-service-ca\") on node \"ip-10-0-143-7.ec2.internal\" DevicePath \"\""
Jul 31 01:11:21.031017 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.030979    2582 generic.go:356] "Generic (PLEG): container finished" podID="aabc12f7-9d6f-461d-a338-4084855925be" containerID="963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a" exitCode=0
Jul 31 01:11:21.031211 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.031024    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"
Jul 31 01:11:21.031211 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.031056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8" event={"ID":"aabc12f7-9d6f-461d-a338-4084855925be","Type":"ContainerDied","Data":"963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a"}
Jul 31 01:11:21.031211 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.031107    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8" event={"ID":"aabc12f7-9d6f-461d-a338-4084855925be","Type":"ContainerDied","Data":"fced6a692b0498701585873bae11ad785780e12050aafbfeb7c1ec868b5feff1"}
Jul 31 01:11:21.031211 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.031138    2582 scope.go:117] "RemoveContainer" containerID="963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a"
Jul 31 01:11:21.040877 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.040859    2582 scope.go:117] "RemoveContainer" containerID="963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a"
Jul 31 01:11:21.041137 ip-10-0-143-7 kubenswrapper[2582]: E0731 01:11:21.041118    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a\": container with ID starting with 963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a not found: ID does not exist" containerID="963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a"
Jul 31 01:11:21.041188 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.041146    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a"} err="failed to get container status \"963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a\": rpc error: code = NotFound desc = could not find container \"963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a\": container with ID starting with 963e600a83c08abf00e65482966c0007e985da13346e642cac80588228e67b8a not found: ID does not exist"
Jul 31 01:11:21.053313 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.053290    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"]
Jul 31 01:11:21.056498 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:21.056477    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b32567-fdc94b754-7swc8"]
Jul 31 01:11:22.248462 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:22.248429    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aabc12f7-9d6f-461d-a338-4084855925be" path="/var/lib/kubelet/pods/aabc12f7-9d6f-461d-a338-4084855925be/volumes"
Jul 31 01:11:34.110377 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:34.110351    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-k7k5m_3215a728-10ce-46ee-bd0a-6c0cd100a38a/copy-manifests/0.log"
Jul 31 01:11:34.116320 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:34.116299    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-k7k5m_3215a728-10ce-46ee-bd0a-6c0cd100a38a/manager/0.log"
Jul 31 01:11:34.489763 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:34.489660    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8f98fb876-pkvw7_ddfaa997-36fc-4ef3-a2c7-19ba7cc8f777/maas-api/0.log"
Jul 31 01:11:34.609926 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:34.609890    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757630-rgbqk_1a493bc7-a619-48fc-8fac-eb63924b2835/cleanup/0.log"
Jul 31 01:11:37.005582 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:37.005549    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-szwqj_4f0c4023-7c5b-4f7e-99dc-403de79acdce/discovery/0.log"
Jul 31 01:11:37.391703 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:37.391594    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rrm47_e95c08bb-7fa6-48d3-9936-0adf0b001f0a/istio-proxy/1.log"
Jul 31 01:11:37.770407 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:37.770377    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-689c4fc56b-qgjfq_80cf608c-b8d4-41a4-96df-41d4f0e9654a/router/0.log"
Jul 31 01:11:38.351453 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:38.351416    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rgjvk_98e74bc1-29ca-4906-9781-5168e2c96367/main/0.log"
Jul 31 01:11:38.467754 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:38.467722    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fn94w6_2c52adc3-8056-4166-be34-da464c5588ef/main/0.log"
Jul 31 01:11:47.274150 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:47.274117    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2cg9j_230af5e7-ff0d-4419-81ef-091cd8219ad9/global-pull-secret-syncer/0.log"
Jul 31 01:11:47.485064 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:47.485032    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dl8tl_c5a03a19-9f05-4a1b-9203-93c05f371a16/konnectivity-agent/0.log"
Jul 31 01:11:47.544055 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:47.543974    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-7.ec2.internal_13a70a09f2dffef1bbceb86aac02062a/haproxy/0.log"
Jul 31 01:11:54.270218 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.270134    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15/alertmanager/0.log"
Jul 31 01:11:54.292295 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.292264    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15/config-reloader/0.log"
Jul 31 01:11:54.312708 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.312680    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15/kube-rbac-proxy-web/0.log"
Jul 31 01:11:54.332050 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.332024    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15/kube-rbac-proxy/0.log"
Jul 31 01:11:54.353818 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.353793    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15/kube-rbac-proxy-metric/0.log"
Jul 31 01:11:54.371320 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.371296    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15/prom-label-proxy/0.log"
Jul 31 01:11:54.391012 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.390990    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fda8c7fa-4f3d-4023-8ebe-12f41b2e0f15/init-config-reloader/0.log"
Jul 31 01:11:54.456996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.456971    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-5ndmv_97b5e3ec-aed7-4579-97cc-c770b618b957/kube-state-metrics/0.log"
Jul 31 01:11:54.471103 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.471070    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-5ndmv_97b5e3ec-aed7-4579-97cc-c770b618b957/kube-rbac-proxy-main/0.log"
Jul 31 01:11:54.490556 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.490532    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-5ndmv_97b5e3ec-aed7-4579-97cc-c770b618b957/kube-rbac-proxy-self/0.log"
Jul 31 01:11:54.607432 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.607358    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnqrr_e04d89f9-08e1-40a2-b952-016d227d70d5/node-exporter/0.log"
Jul 31 01:11:54.630095 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.630069    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnqrr_e04d89f9-08e1-40a2-b952-016d227d70d5/kube-rbac-proxy/0.log"
Jul 31 01:11:54.647831 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:54.647810    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnqrr_e04d89f9-08e1-40a2-b952-016d227d70d5/init-textfile/0.log"
Jul 31 01:11:55.245638 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:55.245598    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-sdrxq_3815dd76-5b55-472d-9c9a-2c2f82a52be1/prometheus-operator/0.log"
Jul 31 01:11:55.260867 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:55.260801    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-sdrxq_3815dd76-5b55-472d-9c9a-2c2f82a52be1/kube-rbac-proxy/0.log"
Jul 31 01:11:55.283598 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:55.283570    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-8jlg5_00e626c1-bab3-47c4-ae44-5db90bdddbb4/prometheus-operator-admission-webhook/0.log"
Jul 31 01:11:55.310014 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:55.309989    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-757666fc54-shgn6_01a5a64d-c57b-4216-a65f-f8e1ad514402/telemeter-client/0.log"
Jul 31 01:11:55.328344 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:55.328314    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-757666fc54-shgn6_01a5a64d-c57b-4216-a65f-f8e1ad514402/reload/0.log"
Jul 31 01:11:55.351171 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:55.351151    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-757666fc54-shgn6_01a5a64d-c57b-4216-a65f-f8e1ad514402/kube-rbac-proxy/0.log"
Jul 31 01:11:56.859073 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:56.859043    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-8c2qb_be762795-9b56-40c0-ba08-0c27c20e465d/networking-console-plugin/0.log"
Jul 31 01:11:57.479696 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:57.479666    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/1.log"
Jul 31 01:11:57.489698 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:57.489665    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-6jz89_998b5748-05d2-49de-8e7f-ec06934bbffd/console-operator/2.log"
Jul 31 01:11:58.096393 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.096363    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-gljgq_0b929b13-ec94-475f-aff1-5f9a42f37175/download-server/0.log"
Jul 31 01:11:58.140365 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140335    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"]
Jul 31 01:11:58.140730 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140717    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy"
Jul 31 01:11:58.140782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140732    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy"
Jul 31 01:11:58.140782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140743    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy"
Jul 31 01:11:58.140782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140750    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy"
Jul 31 01:11:58.140782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140758    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca1bbdd-72ab-4052-9387-bd7778b91d58" containerName="maas-api"
Jul 31 01:11:58.140782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140764    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca1bbdd-72ab-4052-9387-bd7778b91d58" containerName="maas-api"
Jul 31 01:11:58.140782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140771    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy"
Jul 31 01:11:58.140782 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140777    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140787    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cf1133-5032-418d-aaa2-e5b2352e6c6f" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140792    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cf1133-5032-418d-aaa2-e5b2352e6c6f" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140801    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90217b54-3634-4fad-974c-212c7eb46b3d" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140806    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="90217b54-3634-4fad-974c-212c7eb46b3d" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140813    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140818    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140824    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140831    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140845    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aabc12f7-9d6f-461d-a338-4084855925be" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140850    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aabc12f7-9d6f-461d-a338-4084855925be" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140855    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140860    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140934    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="90217b54-3634-4fad-974c-212c7eb46b3d" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140940    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aabc12f7-9d6f-461d-a338-4084855925be" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140947    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa3f757-c433-41ef-9746-b5ee37064266" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140954    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140961    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="db8f782d-7524-4bf0-aa92-20d4b16ee40c" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140968    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140974    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d01a46-30b7-4a21-a2ac-8e2bfd473c68" containerName="istio-proxy"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140981    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cf1133-5032-418d-aaa2-e5b2352e6c6f" containerName="maas-api"
Jul 31 01:11:58.140996 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.140988    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca1bbdd-72ab-4052-9387-bd7778b91d58" containerName="maas-api"
Jul 31 01:11:58.144158 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.144143    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.146987 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.146964    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sj55h\"/\"kube-root-ca.crt\""
Jul 31 01:11:58.148218 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.148198    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sj55h\"/\"openshift-service-ca.crt\""
Jul 31 01:11:58.148321 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.148198    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sj55h\"/\"default-dockercfg-jj2mk\""
Jul 31 01:11:58.160535 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.160505    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"]
Jul 31 01:11:58.199456 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.199427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-podres\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.199570 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.199464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkzqt\" (UniqueName: \"kubernetes.io/projected/a2d7f54c-1280-4417-a96e-312eeba42bbd-kube-api-access-rkzqt\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.199570 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.199485    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-sys\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.199570 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.199508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-proc\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.199570 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.199548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-lib-modules\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300459 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-podres\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300605 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkzqt\" (UniqueName: \"kubernetes.io/projected/a2d7f54c-1280-4417-a96e-312eeba42bbd-kube-api-access-rkzqt\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300605 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-sys\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300605 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-proc\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300605 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-sys\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300605 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-lib-modules\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300605 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-podres\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300894 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-proc\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.300894 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.300690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d7f54c-1280-4417-a96e-312eeba42bbd-lib-modules\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.307921 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.307901    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkzqt\" (UniqueName: \"kubernetes.io/projected/a2d7f54c-1280-4417-a96e-312eeba42bbd-kube-api-access-rkzqt\") pod \"perf-node-gather-daemonset-8n5w8\" (UID: \"a2d7f54c-1280-4417-a96e-312eeba42bbd\") " pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.461241 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.461154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:58.589841 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.589810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"]
Jul 31 01:11:58.591181 ip-10-0-143-7 kubenswrapper[2582]: W0731 01:11:58.591153    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2d7f54c_1280_4417_a96e_312eeba42bbd.slice/crio-4ab6964897ef179a4dbad746a5e496b797bf99ef280836a542324b5b0c76f438 WatchSource:0}: Error finding container 4ab6964897ef179a4dbad746a5e496b797bf99ef280836a542324b5b0c76f438: Status 404 returned error can't find the container with id 4ab6964897ef179a4dbad746a5e496b797bf99ef280836a542324b5b0c76f438
Jul 31 01:11:58.824946 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:58.824918    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-rtzcf_ba9f3cb1-03a8-4bc2-a3a5-463d4f21875d/volume-data-source-validator/0.log"
Jul 31 01:11:59.238252 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:59.238155    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8" event={"ID":"a2d7f54c-1280-4417-a96e-312eeba42bbd","Type":"ContainerStarted","Data":"8b4d50d6aa8eb0f753a1eabfec4feb86de1136a2d06074f6514911d56918d48e"}
Jul 31 01:11:59.238252 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:59.238219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8" event={"ID":"a2d7f54c-1280-4417-a96e-312eeba42bbd","Type":"ContainerStarted","Data":"4ab6964897ef179a4dbad746a5e496b797bf99ef280836a542324b5b0c76f438"}
Jul 31 01:11:59.238252 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:59.238244    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:11:59.256587 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:59.256537    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8" podStartSLOduration=1.256522823 podStartE2EDuration="1.256522823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:11:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:11:59.255303566 +0000 UTC m=+3959.532546554" watchObservedRunningTime="2026-07-31 01:11:59.256522823 +0000 UTC m=+3959.533765811"
Jul 31 01:11:59.994180 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:11:59.994151    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g5cl7_d5a84a2d-03b1-4dca-9812-1fab6279e254/dns/0.log"
Jul 31 01:12:00.013069 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:00.013046    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g5cl7_d5a84a2d-03b1-4dca-9812-1fab6279e254/kube-rbac-proxy/0.log"
Jul 31 01:12:00.164401 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:00.164367    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqxgs_95d8d6a7-a733-4c80-8468-d3d27639d962/dns-node-resolver/0.log"
Jul 31 01:12:00.678300 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:00.678270    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29757600-j2grc_4214a0f7-ace1-4a6b-b45a-42e9edbb4bea/image-pruner/0.log"
Jul 31 01:12:00.782047 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:00.782020    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smd62_efe2d439-2ef6-4a94-87fb-841d5be15612/node-ca/0.log"
Jul 31 01:12:02.069471 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:02.069439    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-szwqj_4f0c4023-7c5b-4f7e-99dc-403de79acdce/discovery/0.log"
Jul 31 01:12:02.137325 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:02.137287    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rrm47_e95c08bb-7fa6-48d3-9936-0adf0b001f0a/istio-proxy/0.log"
Jul 31 01:12:02.150072 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:02.150034    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rrm47_e95c08bb-7fa6-48d3-9936-0adf0b001f0a/istio-proxy/1.log"
Jul 31 01:12:02.224454 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:02.224428    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-689c4fc56b-qgjfq_80cf608c-b8d4-41a4-96df-41d4f0e9654a/router/0.log"
Jul 31 01:12:03.045007 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:03.044975    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptks5_5af8df01-0684-4193-8bae-d83e5be683b8/serve-healthcheck-canary/0.log"
Jul 31 01:12:03.516751 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:03.516724    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-kjp2v_5edd60ed-3278-45f3-8eb8-9dcca014cf43/insights-operator/0.log"
Jul 31 01:12:03.518237 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:03.518218    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-kjp2v_5edd60ed-3278-45f3-8eb8-9dcca014cf43/insights-operator/1.log"
Jul 31 01:12:03.601939 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:03.601911    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tx87b_ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be/kube-rbac-proxy/0.log"
Jul 31 01:12:03.621196 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:03.621173    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tx87b_ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be/exporter/0.log"
Jul 31 01:12:03.640336 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:03.640316    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tx87b_ddd9a01a-63b1-4ffe-84bb-4c7c61aee2be/extractor/0.log"
Jul 31 01:12:05.255013 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:05.254988    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sj55h/perf-node-gather-daemonset-8n5w8"
Jul 31 01:12:06.826374 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:06.826347    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-k7k5m_3215a728-10ce-46ee-bd0a-6c0cd100a38a/manager/0.log"
Jul 31 01:12:06.844432 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:06.844409    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bff98467-k7k5m_3215a728-10ce-46ee-bd0a-6c0cd100a38a/copy-manifests/0.log"
Jul 31 01:12:08.251401 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:08.251365    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dbc4bb7b6-4rrbw_f441d567-6f29-41de-af2e-6fea61f23c7d/manager/0.log"
Jul 31 01:12:08.303055 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:08.302985    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6sfkp_9c9bdf79-48ed-461a-9a53-266a8cb687e5/openshift-lws-operator/0.log"
Jul 31 01:12:09.313288 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:09.313256    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-szwqj_4f0c4023-7c5b-4f7e-99dc-403de79acdce/discovery/0.log"
Jul 31 01:12:09.364316 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:09.364196    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rrm47_e95c08bb-7fa6-48d3-9936-0adf0b001f0a/istio-proxy/0.log"
Jul 31 01:12:09.376882 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:09.376858    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rrm47_e95c08bb-7fa6-48d3-9936-0adf0b001f0a/istio-proxy/1.log"
Jul 31 01:12:09.435920 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:09.435895    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-689c4fc56b-qgjfq_80cf608c-b8d4-41a4-96df-41d4f0e9654a/router/0.log"
Jul 31 01:12:11.169816 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:11.169785    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-szwqj_4f0c4023-7c5b-4f7e-99dc-403de79acdce/discovery/0.log"
Jul 31 01:12:11.217974 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:11.217938    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rrm47_e95c08bb-7fa6-48d3-9936-0adf0b001f0a/istio-proxy/0.log"
Jul 31 01:12:11.232671 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:11.232647    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-rrm47_e95c08bb-7fa6-48d3-9936-0adf0b001f0a/istio-proxy/1.log"
Jul 31 01:12:11.285264 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:11.285237    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-689c4fc56b-qgjfq_80cf608c-b8d4-41a4-96df-41d4f0e9654a/router/0.log"
Jul 31 01:12:14.907678 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:14.907648    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgp6x_a0dc9845-9e58-4a6e-816a-60c3ddb915fc/kube-multus-additional-cni-plugins/0.log"
Jul 31 01:12:14.926276 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:14.926249    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgp6x_a0dc9845-9e58-4a6e-816a-60c3ddb915fc/egress-router-binary-copy/0.log"
Jul 31 01:12:14.945039 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:14.945014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgp6x_a0dc9845-9e58-4a6e-816a-60c3ddb915fc/cni-plugins/0.log"
Jul 31 01:12:14.963035 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:14.963012    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgp6x_a0dc9845-9e58-4a6e-816a-60c3ddb915fc/bond-cni-plugin/0.log"
Jul 31 01:12:14.981118 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:14.981093    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgp6x_a0dc9845-9e58-4a6e-816a-60c3ddb915fc/routeoverride-cni/0.log"
Jul 31 01:12:14.999743 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:14.999714    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgp6x_a0dc9845-9e58-4a6e-816a-60c3ddb915fc/whereabouts-cni-bincopy/0.log"
Jul 31 01:12:15.019363 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:15.019340    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgp6x_a0dc9845-9e58-4a6e-816a-60c3ddb915fc/whereabouts-cni/0.log"
Jul 31 01:12:15.220301 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:15.220224    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-blw55_fcda3902-c297-4dca-912b-7aac26853a2f/kube-multus/0.log"
Jul 31 01:12:15.396397 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:15.396365    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z98bc_29ae0441-1a78-4692-97ad-a2749a174cd3/network-metrics-daemon/0.log"
Jul 31 01:12:15.409409 ip-10-0-143-7 kubenswrapper[2582]: I0731 01:12:15.409378    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z98bc_29ae0441-1a78-4692-97ad-a2749a174cd3/kube-rbac-proxy/0.log"