Jul 17 14:49:46.709291 ip-10-0-143-54 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 14:49:47.011763 ip-10-0-143-54 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 14:49:47.011763 ip-10-0-143-54 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 14:49:47.011763 ip-10-0-143-54 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 14:49:47.011763 ip-10-0-143-54 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 14:49:47.011763 ip-10-0-143-54 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 14:49:47.012577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.012506    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 14:49:47.018841 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018821    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 14:49:47.018841 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018839    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 14:49:47.018841 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018843    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 14:49:47.018841 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018846    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 14:49:47.018841 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018849    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018852    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018855    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018858    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018861    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018863    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018866    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018870    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018872    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018875    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018877    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018880    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018882    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018885    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018887    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018889    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018892    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018894    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018897    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018899    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 14:49:47.019024 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018902    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018904    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018913    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018916    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018919    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018921    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018924    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018927    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018929    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018932    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018934    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018937    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018940    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018943    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018945    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018948    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018950    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018952    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018955    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018957    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 14:49:47.019554 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018960    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018962    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018965    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018968    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018971    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018973    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018976    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018979    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018981    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018983    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018986    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018988    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018991    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018993    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.018997    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019001    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019005    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019009    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019012    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 14:49:47.020052 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019015    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019018    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019021    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019023    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019026    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019029    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019031    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019034    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019050    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019055    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019058    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019061    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019064    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019067    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019069    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019071    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019074    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019076    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019078    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 14:49:47.020507 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019081    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019084    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019086    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019089    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019091    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019094    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019096    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019100    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019102    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019104    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019107    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019109    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019112    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019114    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019117    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019120    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019122    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019786    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019793    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019796    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 14:49:47.020953 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019798    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019801    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019804    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019807    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019809    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019812    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019814    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019817    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019820    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019822    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019825    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019827    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019830    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019832    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019835    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019838    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019840    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019843    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019845    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019847    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 14:49:47.021442 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019850    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019852    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019854    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019857    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019860    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019863    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019865    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019868    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019870    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019873    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019875    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019878    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019880    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019883    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019886    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019888    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019893    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019897    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019900    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019903    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 14:49:47.021926 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019905    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019908    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019910    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019913    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019916    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019919    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019921    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019925    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019927    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019931    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019935    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019938    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019940    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019943    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019946    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019951    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019955    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019958    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019960    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 14:49:47.022444 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019963    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019966    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019968    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019971    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019973    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019976    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019979    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019981    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019983    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019986    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019988    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019990    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019993    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019995    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.019998    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020000    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020003    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020005    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020007    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020010    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 14:49:47.022897 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020012    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020015    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020018    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020020    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020023    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020025    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020028    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020031    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020033    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020051    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020054    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020057    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020060    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020062    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020065    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020068    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020070    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020417    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020422    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 14:49:47.023414 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020425    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020427    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020430    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020433    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020435    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020438    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020440    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020443    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020446    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020450    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020453    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020455    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020458    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020460    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020463    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020466    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020469    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020471    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020474    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 14:49:47.023874 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020477    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020479    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020481    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020484    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020486    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020489    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020491    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020493    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020496    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020498    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020502    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020504    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020506    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020509    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020511    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020514    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020517    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020519    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020522    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020524    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 14:49:47.024350 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020526    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020528    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020531    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020533    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020535    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020538    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020540    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020543    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020546    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020549    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020552    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020554    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020557    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020559    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020561    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020564    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020566    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020568    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020571    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020573    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 14:49:47.024949 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020575    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020579    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020581    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020583    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020586    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020588    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020590    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020593    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020595    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020597    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020600    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020602    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020607    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020609    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020612    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020614    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020617    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020622    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020627    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 14:49:47.025446 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020630    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020633    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020636    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020639    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020642    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020644    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020647    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020649    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020652    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020654    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020656    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020659    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020661    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020663    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020666    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020668    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020671    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020673    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.020675    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020743    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020753    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 14:49:47.025908 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020759    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020763    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020767    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020771    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020776    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020780    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020785    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020788    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020791    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020794    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020797    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020800    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020802    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020806    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020809    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020812    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020816    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020818    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020821    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020824    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020827    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020831    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020833    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 14:49:47.026490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020836    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020839    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020842    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020845    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020847    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020850    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020853    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020859    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020862    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020864    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020867    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020870    2561 flags.go:64] FLAG: --enable-server="true"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020872    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020879    2561 flags.go:64] FLAG: --event-burst="100"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020882    2561 flags.go:64] FLAG: --event-qps="50"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020884    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020887    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020892    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020895    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020898    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020901    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020904    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020906    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020909    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020912    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 14:49:47.027453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020915    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020918    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020920    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020923    2561 flags.go:64] FLAG: --feature-gates=""
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020926    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020929    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020932    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020935    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020937    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020940    2561 flags.go:64] FLAG: --help="false"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020943    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020945    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020948    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020951    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020954    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020957    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020960    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020963    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020965    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020968    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020973    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020975    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020978    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020981    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 14:49:47.028534 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020984    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020987    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020989    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020992    2561 flags.go:64] FLAG: --lock-file=""
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020994    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.020997    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021000    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021005    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021008    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021010    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021013    2561 flags.go:64] FLAG: --logging-format="text"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021016    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021019    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021021    2561 flags.go:64] FLAG: --manifest-url=""
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021024    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021027    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021030    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021034    2561 flags.go:64] FLAG: --max-pods="110"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021051    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021054    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021056    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021059    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021062    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021064    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021067    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 14:49:47.029587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021074    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021077    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021079    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021083    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021086    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021090    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021093    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021096    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021099    2561 flags.go:64] FLAG: --port="10250"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021101    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021104    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c1714828fc80956e"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021107    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021110    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021112    2561 flags.go:64] FLAG: --register-node="true"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021115    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021119    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021122    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021124    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021127    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021130    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021133    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021136    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021138    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021141    2561 flags.go:64] FLAG: --runonce="false"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021144    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 14:49:47.030505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021146    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021149    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021152    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021154    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021157    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021160    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021163    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021166    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021168    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021171    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021175    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021178    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021180    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021183    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021187    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021190    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021193    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021196    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021198    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021201    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021204    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021206    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021209    2561 flags.go:64] FLAG: --v="2"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021213    2561 flags.go:64] FLAG: --version="false"
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021217    2561 flags.go:64] FLAG: --vmodule=""
Jul 17 14:49:47.031617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021220    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021223    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021330    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021333    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021337    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021339    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021342    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021344    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021347    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021350    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021352    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021354    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021357    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021359    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021362    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021364    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021366    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021370    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021422    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021425    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 14:49:47.032297 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021428    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021431    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021433    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021437    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021441    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021443    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021446    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021449    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021452    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021454    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021457    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021459    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021462    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021464    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021467    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021469    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021472    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021474    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021477    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 14:49:47.032992 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021479    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021481    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021483    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021486    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021488    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021491    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021493    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021495    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021498    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021500    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021504    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021506    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021508    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021512    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021515    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021517    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021520    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021522    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021524    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021527    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 14:49:47.033598 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021530    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021532    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021535    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021537    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021541    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021544    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021547    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021550    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021554    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021557    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021560    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021563    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021566    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021569    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021571    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021574    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021577    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021579    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021582    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 14:49:47.034141 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021584    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021586    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021589    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021595    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021597    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021599    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021603    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021606    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021608    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021611    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021613    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021616    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021618    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021621    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021623    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021625    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021628    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021630    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021633    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 14:49:47.034672 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021635    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021638    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021641    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.021644    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.021652    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.028693    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.028714    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.028739    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.028753    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028834    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028841    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028847    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028852    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028857    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028863    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 14:49:47.035189 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028868    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028873    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028877    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028882    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028886    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028890    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028894    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028899    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028904    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028908    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028912    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028916    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028920    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028924    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028928    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028932    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028937    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028941    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028945    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028950    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 14:49:47.035586 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028954    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028958    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028962    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028968    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028972    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028976    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028981    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028985    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028989    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028993    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.028997    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029001    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029006    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029009    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029013    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029017    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029022    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029026    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029031    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029035    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 14:49:47.036196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029061    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029065    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029069    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029073    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029079    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029085    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029089    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029094    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029098    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029102    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029106    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029110    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029114    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029118    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029122    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029126    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029132    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029137    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029141    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029145    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 14:49:47.036983 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029149    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029153    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029157    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029161    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029165    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029170    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029174    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029178    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029182    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029186    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029190    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029194    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029198    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029202    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029206    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029210    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029214    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029218    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029223    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029227    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 14:49:47.037822 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029231    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029237    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029243    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029247    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029251    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029255    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029258    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029264    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029268    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029272    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029276    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029280    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029287    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.029295    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 14:49:47.038628 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029499    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029508    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029513    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029517    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029521    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029525    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029529    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029533    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029537    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029541    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029545    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029550    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029554    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029558    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029562    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029566    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029570    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029574    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029579    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029582    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 14:49:47.039217 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029586    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029590    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029594    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029598    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029602    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029606    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029610    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029615    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029621    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029625    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029629    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029633    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029637    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029641    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029645    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029649    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029653    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029657    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029661    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029665    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 14:49:47.039733 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029669    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029673    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029678    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029682    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029688    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029693    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029697    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029702    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029706    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029709    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029714    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029718    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029722    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029726    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029730    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029734    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029738    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029742    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029746    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 14:49:47.040237 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029750    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029757    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029763    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029768    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029773    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029777    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029781    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029785    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029789    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029795    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029801    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029805    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029809    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029814    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029818    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029823    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029827    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029831    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029836    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 14:49:47.040803 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029840    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029844    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029848    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029852    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029856    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029861    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029865    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029869    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029873    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029876    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029880    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029885    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029889    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029893    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029897    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029901    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029906    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029910    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029914    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029918    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 14:49:47.041306 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:47.029922    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.029929    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.030096    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.033364    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.034524    2561 server.go:1019] "Starting client certificate rotation"
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.034625    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.034665    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.036898    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 14:49:47.041843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.041370    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 14:49:47.049273 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.049256    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 17 14:49:47.052090 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.052028    2561 log.go:25] "Validated CRI v1 image API"
Jul 17 14:49:47.052827 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.052809    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 14:49:47.054709 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.054681    2561 fs.go:135] Filesystem UUIDs: map[2d4daaf0-18f4-4d3b-8af7-7fd1263909ca:/dev/nvme0n1p4 6a1232fb-37fc-4b2c-9412-8a93c4594eea:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 17 14:49:47.054793 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.054708    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 14:49:47.059601 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.059490    2561 manager.go:216] Machine: {Timestamp:2026-07-17 14:49:47.058343002 +0000 UTC m=+0.256607331 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3162503 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208c47e084d37d02acd52c663d519e SystemUUID:ec208c47-e084-d37d-02ac-d52c663d519e BootID:3a6e8a1a-1c71-4cd4-bbab-64ef92283376 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:96:86:02:bd:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:96:86:02:bd:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:3c:0c:8a:e6:87 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 14:49:47.059601 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.059593    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 14:49:47.059755 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.059694    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 14:49:47.062456 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.062434    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 14:49:47.062584 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.062458    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 14:49:47.063640 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.063630    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 14:49:47.063676 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.063643    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 14:49:47.063676 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.063654    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 14:49:47.064175 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.064161    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 14:49:47.065333 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.065322    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 14:49:47.069010 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.068999    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 14:49:47.069144 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.069134    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 14:49:47.069767 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.069758    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 14:49:47.069797 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.069775    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 14:49:47.069797 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.069789    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 14:49:47.069797 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.069797    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 17 14:49:47.069920 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.069806    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 14:49:47.070156 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.070144    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 14:49:47.070192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.070166    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 14:49:47.071863 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.071845    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 14:49:47.074766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.074746    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 14:49:47.074841 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.074795    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 14:49:47.075514 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.075498    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 14:49:47.076203 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076191    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 14:49:47.076239 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076208    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 14:49:47.076239 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076214    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 14:49:47.076239 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076219    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 14:49:47.076239 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076227    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 14:49:47.076239 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076231    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 14:49:47.076239 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076239    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 14:49:47.076394 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076244    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 14:49:47.076394 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076250    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 14:49:47.076394 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076255    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 14:49:47.076394 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076268    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 14:49:47.076394 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076273    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 14:49:47.076848 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076840    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 14:49:47.076880 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.076849    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 14:49:47.080269 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.080246    2561 server.go:1268] "Started kubelet"
Jul 17 14:49:47.080382 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.080354    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 14:49:47.080558 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.080336    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 14:49:47.080638 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.080561    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 14:49:47.081198 ip-10-0-143-54 systemd[1]: Started Kubernetes Kubelet.
Jul 17 14:49:47.082092 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.082078    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 14:49:47.082342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.082324    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 14:49:47.085454 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.085423    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 14:49:47.087120 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.087100    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 14:49:47.087234 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.087210    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 14:49:47.087317 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.087246    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 14:49:47.087353 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.086598    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-54.ec2.internal.18c31b33e5b8b226  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-54.ec2.internal,UID:ip-10-0-143-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-54.ec2.internal,},FirstTimestamp:2026-07-17 14:49:47.080217126 +0000 UTC m=+0.278481455,LastTimestamp:2026-07-17 14:49:47.080217126 +0000 UTC m=+0.278481455,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-54.ec2.internal,}"
Jul 17 14:49:47.088488 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.088467    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 14:49:47.088488 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.088471    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 14:49:47.088602 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.088533    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.088973 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.088958    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 14:49:47.089127 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089017    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 14:49:47.089127 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089051    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 14:49:47.089127 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089127    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 14:49:47.089265 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089137    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 14:49:47.089265 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089243    2561 factory.go:55] Registering systemd factory
Jul 17 14:49:47.089265 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089258    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 17 14:49:47.089454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089440    2561 factory.go:153] Registering CRI-O factory
Jul 17 14:49:47.089454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089455    2561 factory.go:223] Registration of the crio container factory successfully
Jul 17 14:49:47.089571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089514    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 14:49:47.089571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089533    2561 factory.go:103] Registering Raw factory
Jul 17 14:49:47.089571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.089546    2561 manager.go:1196] Started watching for new ooms in manager
Jul 17 14:49:47.090124 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.090110    2561 manager.go:349] Starting recovery of all containers
Jul 17 14:49:47.094474 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.094448    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 14:49:47.094561 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.094530    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 14:49:47.101178 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.101021    2561 manager.go:354] Recovery completed
Jul 17 14:49:47.102765 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.102739    2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 17 14:49:47.105711 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.105695    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 14:49:47.107443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.107426    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 14:49:47.107514 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.107454    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 14:49:47.107514 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.107464    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID"
Jul 17 14:49:47.107886 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.107873    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 14:49:47.107886 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.107882    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 14:49:47.108016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.107885    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 14:49:47.108016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.107923    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 14:49:47.108512 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.108497    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 14:49:47.108566 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.108522    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 14:49:47.108566 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.108531    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID"
Jul 17 14:49:47.110164 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.110151    2561 policy_none.go:49] "None policy: Start"
Jul 17 14:49:47.110231 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.110170    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 14:49:47.110231 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.110183    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 14:49:47.112034 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.111971    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-54.ec2.internal.18c31b33e7581a7f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-54.ec2.internal,UID:ip-10-0-143-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-54.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-54.ec2.internal,},FirstTimestamp:2026-07-17 14:49:47.107441279 +0000 UTC m=+0.305705608,LastTimestamp:2026-07-17 14:49:47.107441279 +0000 UTC m=+0.305705608,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-54.ec2.internal,}"
Jul 17 14:49:47.112147 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.112136    2561 policy_none.go:47] "Start"
Jul 17 14:49:47.127095 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.127022    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-54.ec2.internal.18c31b33e7585f53  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-54.ec2.internal,UID:ip-10-0-143-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-54.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-54.ec2.internal,},FirstTimestamp:2026-07-17 14:49:47.107458899 +0000 UTC m=+0.305723227,LastTimestamp:2026-07-17 14:49:47.107458899 +0000 UTC m=+0.305723227,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-54.ec2.internal,}"
Jul 17 14:49:47.128692 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.128672    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fpdx4"
Jul 17 14:49:47.139253 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.139234    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fpdx4"
Jul 17 14:49:47.144352 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.144340    2561 manager.go:337] "Starting Device Plugin manager"
Jul 17 14:49:47.144430 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.144364    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 14:49:47.144430 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.144373    2561 server.go:87] "Starting device plugin registration server"
Jul 17 14:49:47.144575 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.144561    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 14:49:47.144651 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.144575    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 14:49:47.144729 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.144713    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 14:49:47.144802 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.144785    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 14:49:47.144802 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.144794    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 14:49:47.145257 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.145235    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 14:49:47.145332 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.145290    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.224433 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.224400    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 14:49:47.226525 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.225658    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 14:49:47.226525 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.225699    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 14:49:47.226525 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.225724    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 14:49:47.226525 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.225760    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 14:49:47.229438 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.229424    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 14:49:47.244805 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.244792    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 14:49:47.245500 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.245486    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 14:49:47.245579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.245513    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 14:49:47.245579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.245525    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID"
Jul 17 14:49:47.245579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.245544    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.263796 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.263757    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.263796 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.263776    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-54.ec2.internal\": node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.323882 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.323862    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.325950 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.325936    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"]
Jul 17 14:49:47.325998 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.325991    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 14:49:47.326693 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.326678    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 14:49:47.326760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.326704    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 14:49:47.326760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.326719    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID"
Jul 17 14:49:47.329061 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329032    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 14:49:47.329146 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329133    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.329192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329160    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 14:49:47.329656 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329641    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 14:49:47.329656 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329651    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 14:49:47.329760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329672    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 14:49:47.329760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329687    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID"
Jul 17 14:49:47.329760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329674    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 14:49:47.329760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.329760    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID"
Jul 17 14:49:47.331909 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.331894    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.331984 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.331928    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 14:49:47.332508 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.332494    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 14:49:47.332586 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.332518    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 14:49:47.332586 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.332532    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeHasSufficientPID"
Jul 17 14:49:47.362637 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.362612    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-54.ec2.internal\" not found" node="ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.366947 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.366930    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-54.ec2.internal\" not found" node="ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.424596 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.424573    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.490546 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.490522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77a81f731c7bc318ff3a837aa25ff363-config\") pod \"kube-apiserver-proxy-ip-10-0-143-54.ec2.internal\" (UID: \"77a81f731c7bc318ff3a837aa25ff363\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.490629 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.490579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/360faf7de2471d13b7bacaacebf10202-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"360faf7de2471d13b7bacaacebf10202\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.490629 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.490617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/360faf7de2471d13b7bacaacebf10202-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"360faf7de2471d13b7bacaacebf10202\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.525122 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.525069    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.591595 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.591572    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77a81f731c7bc318ff3a837aa25ff363-config\") pod \"kube-apiserver-proxy-ip-10-0-143-54.ec2.internal\" (UID: \"77a81f731c7bc318ff3a837aa25ff363\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.591695 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.591604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/360faf7de2471d13b7bacaacebf10202-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"360faf7de2471d13b7bacaacebf10202\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.591695 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.591631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/360faf7de2471d13b7bacaacebf10202-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"360faf7de2471d13b7bacaacebf10202\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.591695 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.591682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/360faf7de2471d13b7bacaacebf10202-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"360faf7de2471d13b7bacaacebf10202\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.591695 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.591684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/360faf7de2471d13b7bacaacebf10202-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal\" (UID: \"360faf7de2471d13b7bacaacebf10202\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.591834 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.591682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77a81f731c7bc318ff3a837aa25ff363-config\") pod \"kube-apiserver-proxy-ip-10-0-143-54.ec2.internal\" (UID: \"77a81f731c7bc318ff3a837aa25ff363\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.625692 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.625661    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.665828 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.665810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.668902 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:47.668887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:47.726412 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.726380    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.826903 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.826825    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:47.927278 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:47.927251    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:48.027941 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:48.027895    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:48.034062 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.034030    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 14:49:48.034205 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.034188    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 14:49:48.128744 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:48.128719    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:48.144343 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.144311    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 14:44:46 +0000 UTC" deadline="2028-02-14 14:10:57.012321739 +0000 UTC"
Jul 17 14:49:48.144343 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.144341    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13847h21m8.867984271s"
Jul 17 14:49:48.186831 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.186807    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 14:49:48.229085 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:48.229065    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-54.ec2.internal\" not found"
Jul 17 14:49:48.237323 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:48.237293    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360faf7de2471d13b7bacaacebf10202.slice/crio-9a44840df5fdde1cf4d143d3f97d087417d7531b1910e1dc0dd28cceba755206 WatchSource:0}: Error finding container 9a44840df5fdde1cf4d143d3f97d087417d7531b1910e1dc0dd28cceba755206: Status 404 returned error can't find the container with id 9a44840df5fdde1cf4d143d3f97d087417d7531b1910e1dc0dd28cceba755206
Jul 17 14:49:48.237775 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:48.237750    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a81f731c7bc318ff3a837aa25ff363.slice/crio-138d6db4893e6f3443bd215ecb4f6aafa61a6d6d92bbc7476356a6fed2316b16 WatchSource:0}: Error finding container 138d6db4893e6f3443bd215ecb4f6aafa61a6d6d92bbc7476356a6fed2316b16: Status 404 returned error can't find the container with id 138d6db4893e6f3443bd215ecb4f6aafa61a6d6d92bbc7476356a6fed2316b16
Jul 17 14:49:48.238120 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.238104    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 14:49:48.242175 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.242161    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 14:49:48.270556 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.270534    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 14:49:48.289506 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.289488    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:48.335483 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.335464    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 14:49:48.336300 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.336289    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal"
Jul 17 14:49:48.356753 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.356737    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 14:49:48.942461 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:48.942401    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 14:49:49.070928 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.070907    2561 apiserver.go:52] "Watching apiserver"
Jul 17 14:49:49.076693 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.076673    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 14:49:49.077455 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.077435    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-bbb7m","openshift-image-registry/node-ca-xsllf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal","kube-system/konnectivity-agent-6pvb7","kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"]
Jul 17 14:49:49.079851 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.079829    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.081833 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.081810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.083760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.083744    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.085660 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.085642    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.089154 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.089138    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 14:49:49.089474 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.089459    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 14:49:49.091504 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091147    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 14:49:49.091504 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091232    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 14:49:49.091504 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091304    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 14:49:49.091504 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091312    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 14:49:49.091504 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091359    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 14:49:49.091798 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091546    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 14:49:49.091798 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091672    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 14:49:49.091868 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.091803    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 14:49:49.092783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.092754    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-85k9l\""
Jul 17 14:49:49.092867 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.092786    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 14:49:49.092867 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.092754    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-58knt\""
Jul 17 14:49:49.093185 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.093171    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vhzfk\""
Jul 17 14:49:49.093323 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.093312    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-clq4r\""
Jul 17 14:49:49.097333 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.097167    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.098828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysctl-conf\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.098865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.098893    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysconfig\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.098915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-kubernetes\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.098941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee64d92-e77b-4068-8d67-2a37ebff02e0-tmp\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.098977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-socket-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099003    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-etc-selinux\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-sys-fs\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysctl-d\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-lib-modules\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-tuned\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099162    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqz2g\" (UniqueName: \"kubernetes.io/projected/5b68c8aa-0cd6-4cae-b8be-a363304f4383-kube-api-access-nqz2g\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a444da6a-896e-4cf9-8707-e37a52512923-agent-certs\") pod \"konnectivity-agent-6pvb7\" (UID: \"a444da6a-896e-4cf9-8707-e37a52512923\") " pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-host\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-modprobe-d\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.100748 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e27ec93-6172-4179-9dfa-0f23b6ee274d-serviceca\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a444da6a-896e-4cf9-8707-e37a52512923-konnectivity-ca\") pod \"konnectivity-agent-6pvb7\" (UID: \"a444da6a-896e-4cf9-8707-e37a52512923\") " pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-device-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-systemd\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8t5\" (UniqueName: \"kubernetes.io/projected/5e27ec93-6172-4179-9dfa-0f23b6ee274d-kube-api-access-bc8t5\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-var-lib-kubelet\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-run\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-sys\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e27ec93-6172-4179-9dfa-0f23b6ee274d-host\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d645q\" (UniqueName: \"kubernetes.io/projected/aee64d92-e77b-4068-8d67-2a37ebff02e0-kube-api-access-d645q\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.101374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.099541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-registration-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.111577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.111562    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 14:49:49.147381 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.147361    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gpz9k"
Jul 17 14:49:49.164456 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.164433    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gpz9k"
Jul 17 14:49:49.200004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.199944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.199978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysconfig\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.199993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-kubernetes\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee64d92-e77b-4068-8d67-2a37ebff02e0-tmp\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-socket-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-etc-selinux\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200087    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysconfig\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-kubernetes\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-sys-fs\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-sys-fs\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysctl-d\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-lib-modules\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-tuned\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-etc-selinux\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqz2g\" (UniqueName: \"kubernetes.io/projected/5b68c8aa-0cd6-4cae-b8be-a363304f4383-kube-api-access-nqz2g\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a444da6a-896e-4cf9-8707-e37a52512923-agent-certs\") pod \"konnectivity-agent-6pvb7\" (UID: \"a444da6a-896e-4cf9-8707-e37a52512923\") " pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysctl-d\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-host\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-modprobe-d\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200273    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-lib-modules\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e27ec93-6172-4179-9dfa-0f23b6ee274d-serviceca\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a444da6a-896e-4cf9-8707-e37a52512923-konnectivity-ca\") pod \"konnectivity-agent-6pvb7\" (UID: \"a444da6a-896e-4cf9-8707-e37a52512923\") " pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-device-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200328    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-systemd\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8t5\" (UniqueName: \"kubernetes.io/projected/5e27ec93-6172-4179-9dfa-0f23b6ee274d-kube-api-access-bc8t5\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-var-lib-kubelet\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-run\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-sys\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e27ec93-6172-4179-9dfa-0f23b6ee274d-host\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d645q\" (UniqueName: \"kubernetes.io/projected/aee64d92-e77b-4068-8d67-2a37ebff02e0-kube-api-access-d645q\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-registration-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.200707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysctl-conf\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200538    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-sysctl-conf\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e27ec93-6172-4179-9dfa-0f23b6ee274d-host\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-sys\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e27ec93-6172-4179-9dfa-0f23b6ee274d-serviceca\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-socket-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-systemd\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-run\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-registration-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200635    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b68c8aa-0cd6-4cae-b8be-a363304f4383-device-dir\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-modprobe-d\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-host\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.200921    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee64d92-e77b-4068-8d67-2a37ebff02e0-var-lib-kubelet\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.201926 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.201445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a444da6a-896e-4cf9-8707-e37a52512923-konnectivity-ca\") pod \"konnectivity-agent-6pvb7\" (UID: \"a444da6a-896e-4cf9-8707-e37a52512923\") " pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.203400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.203381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee64d92-e77b-4068-8d67-2a37ebff02e0-tmp\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.203599 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.203583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aee64d92-e77b-4068-8d67-2a37ebff02e0-etc-tuned\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.203687 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.203665    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a444da6a-896e-4cf9-8707-e37a52512923-agent-certs\") pod \"konnectivity-agent-6pvb7\" (UID: \"a444da6a-896e-4cf9-8707-e37a52512923\") " pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.219599 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.219582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqz2g\" (UniqueName: \"kubernetes.io/projected/5b68c8aa-0cd6-4cae-b8be-a363304f4383-kube-api-access-nqz2g\") pod \"aws-ebs-csi-driver-node-nb4l6\" (UID: \"5b68c8aa-0cd6-4cae-b8be-a363304f4383\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.222662 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.222642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d645q\" (UniqueName: \"kubernetes.io/projected/aee64d92-e77b-4068-8d67-2a37ebff02e0-kube-api-access-d645q\") pod \"tuned-bbb7m\" (UID: \"aee64d92-e77b-4068-8d67-2a37ebff02e0\") " pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.227384 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.227364    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8t5\" (UniqueName: \"kubernetes.io/projected/5e27ec93-6172-4179-9dfa-0f23b6ee274d-kube-api-access-bc8t5\") pod \"node-ca-xsllf\" (UID: \"5e27ec93-6172-4179-9dfa-0f23b6ee274d\") " pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.230735 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.230694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" event={"ID":"360faf7de2471d13b7bacaacebf10202","Type":"ContainerStarted","Data":"9a44840df5fdde1cf4d143d3f97d087417d7531b1910e1dc0dd28cceba755206"}
Jul 17 14:49:49.231659 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.231636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" event={"ID":"77a81f731c7bc318ff3a837aa25ff363","Type":"ContainerStarted","Data":"138d6db4893e6f3443bd215ecb4f6aafa61a6d6d92bbc7476356a6fed2316b16"}
Jul 17 14:49:49.393518 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.393485    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bbb7m"
Jul 17 14:49:49.399478 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.399461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xsllf"
Jul 17 14:49:49.408091 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.408074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:49.410440 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.410419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6"
Jul 17 14:49:49.413519 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.413502    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dwst6"]
Jul 17 14:49:49.415723 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.415703    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.415811 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:49.415792    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:49:49.502310 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.502247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.502310 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.502286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/593de47b-3614-4449-9ccb-a4b5343620a8-kubelet-config\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.502310 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.502306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/593de47b-3614-4449-9ccb-a4b5343620a8-dbus\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.602578 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.602552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/593de47b-3614-4449-9ccb-a4b5343620a8-kubelet-config\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.602578 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.602581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/593de47b-3614-4449-9ccb-a4b5343620a8-dbus\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.602757 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.602601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.602757 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.602670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/593de47b-3614-4449-9ccb-a4b5343620a8-kubelet-config\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.602757 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:49.602679    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:49.602841 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:49.602775    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:50.102753118 +0000 UTC m=+3.301017448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:49.602841 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:49.602792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/593de47b-3614-4449-9ccb-a4b5343620a8-dbus\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:49.941431 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:49.941401    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee64d92_e77b_4068_8d67_2a37ebff02e0.slice/crio-124903d4ac561182ab0f31f2e4d78d9a5152a4645cdffba7d3e30567f674a01b WatchSource:0}: Error finding container 124903d4ac561182ab0f31f2e4d78d9a5152a4645cdffba7d3e30567f674a01b: Status 404 returned error can't find the container with id 124903d4ac561182ab0f31f2e4d78d9a5152a4645cdffba7d3e30567f674a01b
Jul 17 14:49:49.943348 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:49.942434    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e27ec93_6172_4179_9dfa_0f23b6ee274d.slice/crio-6fd91515d5b512d4e9220df60dd0571da9839344984c852ea3a3d25950d3145d WatchSource:0}: Error finding container 6fd91515d5b512d4e9220df60dd0571da9839344984c852ea3a3d25950d3145d: Status 404 returned error can't find the container with id 6fd91515d5b512d4e9220df60dd0571da9839344984c852ea3a3d25950d3145d
Jul 17 14:49:49.944612 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:49.944271    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b68c8aa_0cd6_4cae_b8be_a363304f4383.slice/crio-0c5254d1d8504105da9d2338c05cfe291e42aa02c055175dda669cf463ee8105 WatchSource:0}: Error finding container 0c5254d1d8504105da9d2338c05cfe291e42aa02c055175dda669cf463ee8105: Status 404 returned error can't find the container with id 0c5254d1d8504105da9d2338c05cfe291e42aa02c055175dda669cf463ee8105
Jul 17 14:49:49.946175 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:49:49.946097    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda444da6a_896e_4cf9_8707_e37a52512923.slice/crio-711cc610f14a63f0621d97fbae92a768d356ae223fd10a698dd352900854ab83 WatchSource:0}: Error finding container 711cc610f14a63f0621d97fbae92a768d356ae223fd10a698dd352900854ab83: Status 404 returned error can't find the container with id 711cc610f14a63f0621d97fbae92a768d356ae223fd10a698dd352900854ab83
Jul 17 14:49:50.107396 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.107271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:50.107724 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:50.107398    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:50.107724 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:50.107448    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:51.107435363 +0000 UTC m=+4.305699677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:50.167443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.167419    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 14:44:49 +0000 UTC" deadline="2028-03-26 19:31:28.530963626 +0000 UTC"
Jul 17 14:49:50.167443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.167442    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14836h41m38.363523302s"
Jul 17 14:49:50.234585 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.234506    2561 generic.go:356] "Generic (PLEG): container finished" podID="360faf7de2471d13b7bacaacebf10202" containerID="56b552ca9ac5be5471ac72b7d1bce1844648b4fb474b6cbfb5f08caa66427f62" exitCode=0
Jul 17 14:49:50.234585 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.234568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" event={"ID":"360faf7de2471d13b7bacaacebf10202","Type":"ContainerDied","Data":"56b552ca9ac5be5471ac72b7d1bce1844648b4fb474b6cbfb5f08caa66427f62"}
Jul 17 14:49:50.235930 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.235907    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" event={"ID":"77a81f731c7bc318ff3a837aa25ff363","Type":"ContainerStarted","Data":"84e02948fdfbf40ba0b28f948cfcff3ee81625a03f61871f808ca47a7115a313"}
Jul 17 14:49:50.236864 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.236843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pvb7" event={"ID":"a444da6a-896e-4cf9-8707-e37a52512923","Type":"ContainerStarted","Data":"711cc610f14a63f0621d97fbae92a768d356ae223fd10a698dd352900854ab83"}
Jul 17 14:49:50.237771 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.237751    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6" event={"ID":"5b68c8aa-0cd6-4cae-b8be-a363304f4383","Type":"ContainerStarted","Data":"0c5254d1d8504105da9d2338c05cfe291e42aa02c055175dda669cf463ee8105"}
Jul 17 14:49:50.238723 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.238707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xsllf" event={"ID":"5e27ec93-6172-4179-9dfa-0f23b6ee274d","Type":"ContainerStarted","Data":"6fd91515d5b512d4e9220df60dd0571da9839344984c852ea3a3d25950d3145d"}
Jul 17 14:49:50.239680 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:50.239663    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bbb7m" event={"ID":"aee64d92-e77b-4068-8d67-2a37ebff02e0","Type":"ContainerStarted","Data":"124903d4ac561182ab0f31f2e4d78d9a5152a4645cdffba7d3e30567f674a01b"}
Jul 17 14:49:51.115220 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:51.115184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:51.115689 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:51.115307    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:51.115689 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:51.115363    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:53.115349594 +0000 UTC m=+6.313613911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:51.167750 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:51.167676    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 14:44:49 +0000 UTC" deadline="2028-01-31 07:40:46.260339488 +0000 UTC"
Jul 17 14:49:51.167750 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:51.167713    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13504h50m55.092631143s"
Jul 17 14:49:51.226783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:51.226132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:51.226783 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:51.226267    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:49:51.245194 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:51.245131    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" event={"ID":"360faf7de2471d13b7bacaacebf10202","Type":"ContainerStarted","Data":"28feefde807b5afc8a8f82df601e3d0d84b39288e199910ce00c966aa3368423"}
Jul 17 14:49:51.293377 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:51.293327    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-54.ec2.internal" podStartSLOduration=3.293306673 podStartE2EDuration="3.293306673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:50.448540996 +0000 UTC m=+3.646805334" watchObservedRunningTime="2026-07-17 14:49:51.293306673 +0000 UTC m=+4.491571014"
Jul 17 14:49:51.293738 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:51.293697    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-54.ec2.internal" podStartSLOduration=3.293686894 podStartE2EDuration="3.293686894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:51.293521145 +0000 UTC m=+4.491785483" watchObservedRunningTime="2026-07-17 14:49:51.293686894 +0000 UTC m=+4.491951235"
Jul 17 14:49:53.126016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.125942    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:53.126482 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:53.126066    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:53.126482 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:53.126144    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:49:57.126131389 +0000 UTC m=+10.324395705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:53.228658 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.228635    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:53.228791 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:53.228745    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:49:53.249234 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.249200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pvb7" event={"ID":"a444da6a-896e-4cf9-8707-e37a52512923","Type":"ContainerStarted","Data":"f348787cac4260228eeb0e5e987445c00a8aba4b5b1f9cc6129e4673549187a5"}
Jul 17 14:49:53.252867 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.252842    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6" event={"ID":"5b68c8aa-0cd6-4cae-b8be-a363304f4383","Type":"ContainerStarted","Data":"ff4dfe6494813f947a4c08c288c1e607966dcc45d851ab9df56c59a131921db9"}
Jul 17 14:49:53.254140 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.254119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xsllf" event={"ID":"5e27ec93-6172-4179-9dfa-0f23b6ee274d","Type":"ContainerStarted","Data":"2c6432e21e1bcca24a34d63f0c80c97549bb4c031d0f9791cc3555df2f0a433c"}
Jul 17 14:49:53.284830 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.284792    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6pvb7" podStartSLOduration=3.345385337 podStartE2EDuration="6.284779859s" totalImagesPullingTime="2.939394522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:53.268585683 +0000 UTC m=+6.466850020" watchObservedRunningTime="2026-07-17 14:49:53.284779859 +0000 UTC m=+6.483044174"
Jul 17 14:49:53.285052 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.285017    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xsllf" podStartSLOduration=3.339782805 podStartE2EDuration="6.285011732s" totalImagesPullingTime="2.945228927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:53.284867283 +0000 UTC m=+6.483131624" watchObservedRunningTime="2026-07-17 14:49:53.285011732 +0000 UTC m=+6.483276069"
Jul 17 14:49:53.947717 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.947679    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:53.948321 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:53.948301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:49:55.228320 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:55.228300    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:55.228692 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:55.228417    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:49:55.258267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:55.258233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bbb7m" event={"ID":"aee64d92-e77b-4068-8d67-2a37ebff02e0","Type":"ContainerStarted","Data":"979340b92ba0834d388db71b1de0cc5e24ef2d714194cd32c796cf1394e8165f"}
Jul 17 14:49:55.258267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:55.258253    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 14:49:55.773995 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:55.773968    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 14:49:56.150222 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:56.150090    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T14:49:55.773987679Z","UUID":"b15cb8af-df39-45a7-8c3f-2a74302d1c51","Handler":null,"Name":"","Endpoint":""}
Jul 17 14:49:56.151489 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:56.151472    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 14:49:56.151601 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:56.151501    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 14:49:56.262190 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:56.262158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6" event={"ID":"5b68c8aa-0cd6-4cae-b8be-a363304f4383","Type":"ContainerStarted","Data":"772055e6c0e1e37df34e580fe26fcdaba4e0491d3cd0917e06364d61abeb5520"}
Jul 17 14:49:57.152090 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:57.152009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:57.152229 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:57.152122    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:57.152229 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:57.152161    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:05.152149216 +0000 UTC m=+18.350413532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:49:57.226516 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:57.226488    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:57.226638 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:57.226571    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:49:57.264750 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:57.264725    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6" event={"ID":"5b68c8aa-0cd6-4cae-b8be-a363304f4383","Type":"ContainerStarted","Data":"a863014eb2a7f4dd85252868bc01760814deddeb2d34f8f1089a88388aab014c"}
Jul 17 14:49:57.293596 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:57.293559    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nb4l6" podStartSLOduration=3.770010735 podStartE2EDuration="10.293547354s" totalImagesPullingTime="6.523536619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:57.293501011 +0000 UTC m=+10.491765348" watchObservedRunningTime="2026-07-17 14:49:57.293547354 +0000 UTC m=+10.491811691"
Jul 17 14:49:57.293681 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:57.293646    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bbb7m" podStartSLOduration=5.134538038 podStartE2EDuration="10.293641532s" totalImagesPullingTime="5.159103494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:49:55.303475787 +0000 UTC m=+8.501740124" watchObservedRunningTime="2026-07-17 14:49:57.293641532 +0000 UTC m=+10.491905870"
Jul 17 14:49:59.228343 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:49:59.228175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:49:59.228710 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:49:59.228405    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:01.226087 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:01.226058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:01.226462 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:01.226154    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:03.226653 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:03.226622    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:03.227134 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:03.226711    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:04.859028 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:04.859000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:50:04.859387 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:04.859117    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 14:50:04.859580 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:04.859564    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6pvb7"
Jul 17 14:50:05.203773 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:05.203697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:05.203898 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:05.203800    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:50:05.203898 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:05.203852    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:21.203838401 +0000 UTC m=+34.402102717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:50:05.226094 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:05.226070    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:05.226205 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:05.226162    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:07.226365 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:07.226339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:07.226703 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:07.226418    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:09.226248 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:09.226222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:09.226631 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:09.226313    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:11.226592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:11.226560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:11.227176 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:11.226653    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:13.226718 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:13.226691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:13.227093 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:13.226785    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:15.229374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:15.229348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:15.229757 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:15.229445    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:17.228615 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:17.228589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:17.228983 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:17.228677    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:19.226576 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.226547    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:19.226957 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:19.226649    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:19.869208 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.869177    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-sppht"]
Jul 17 14:50:19.921129 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.921106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sppht"
Jul 17 14:50:19.924259 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.924235    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95ht5\""
Jul 17 14:50:19.924259 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.924251    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 14:50:19.924427 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.924286    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 14:50:19.924427 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.924289    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 14:50:19.925115 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:19.925099    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 14:50:20.001580 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-etc-kubernetes\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001671 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-k8s-cni-cncf-io\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001671 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-netns\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001671 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-cni-bin\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001768 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119823c3-d23a-4430-bf25-b43af13da224-multus-daemon-config\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001768 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-multus-certs\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001768 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bcv9\" (UniqueName: \"kubernetes.io/projected/119823c3-d23a-4430-bf25-b43af13da224-kube-api-access-5bcv9\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001768 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-socket-dir-parent\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-system-cni-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119823c3-d23a-4430-bf25-b43af13da224-cni-binary-copy\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-cnibin\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001820    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-cni-multus\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-kubelet\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-cni-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.001882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-os-release\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.002102 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-hostroot\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.002102 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.001906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-conf-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.056229 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.056208    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-2mbnm"]
Jul 17 14:50:20.068371 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.068353    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.071070 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.071053    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 14:50:20.071573 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.071557    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 14:50:20.071624 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.071563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwxk5\""
Jul 17 14:50:20.102085 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-k8s-cni-cncf-io\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102162 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-netns\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102162 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119823c3-d23a-4430-bf25-b43af13da224-multus-daemon-config\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102162 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102124    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bcv9\" (UniqueName: \"kubernetes.io/projected/119823c3-d23a-4430-bf25-b43af13da224-kube-api-access-5bcv9\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102162 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-system-cni-dir\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-netns\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-socket-dir-parent\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-k8s-cni-cncf-io\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtrb7\" (UniqueName: \"kubernetes.io/projected/266d2302-bccf-4cfc-a4cd-58b44ccc8984-kube-api-access-dtrb7\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119823c3-d23a-4430-bf25-b43af13da224-cni-binary-copy\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-socket-dir-parent\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-cni-multus\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-kubelet\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102322 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-cni-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102328    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-cni-multus\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-os-release\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-kubelet\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-conf-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cnibin\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-multus-certs\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-conf-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-run-multus-certs\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102478    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-multus-cni-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-cni-bin\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102555    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-host-var-lib-cni-bin\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-system-cni-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-cnibin\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-system-cni-dir\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-os-release\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.102857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119823c3-d23a-4430-bf25-b43af13da224-cni-binary-copy\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-hostroot\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-cnibin\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102689    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-os-release\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/119823c3-d23a-4430-bf25-b43af13da224-multus-daemon-config\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-hostroot\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-etc-kubernetes\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.103418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.102799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/119823c3-d23a-4430-bf25-b43af13da224-etc-kubernetes\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.115558 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.115536    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bcv9\" (UniqueName: \"kubernetes.io/projected/119823c3-d23a-4430-bf25-b43af13da224-kube-api-access-5bcv9\") pod \"multus-sppht\" (UID: \"119823c3-d23a-4430-bf25-b43af13da224\") " pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.203816 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.203816 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-system-cni-dir\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.203816 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrb7\" (UniqueName: \"kubernetes.io/projected/266d2302-bccf-4cfc-a4cd-58b44ccc8984-kube-api-access-dtrb7\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-os-release\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-system-cni-dir\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203870    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cnibin\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203925    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-os-release\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204015 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.203993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cnibin\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204404 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.204086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/266d2302-bccf-4cfc-a4cd-58b44ccc8984-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204478 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.204462    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204512 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.204488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.204544 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.204489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/266d2302-bccf-4cfc-a4cd-58b44ccc8984-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.217382 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.217356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtrb7\" (UniqueName: \"kubernetes.io/projected/266d2302-bccf-4cfc-a4cd-58b44ccc8984-kube-api-access-dtrb7\") pod \"multus-additional-cni-plugins-2mbnm\" (UID: \"266d2302-bccf-4cfc-a4cd-58b44ccc8984\") " pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.229784 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.229766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sppht"
Jul 17 14:50:20.278181 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:50:20.278161    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119823c3_d23a_4430_bf25_b43af13da224.slice/crio-7f79db8da7ac8f5ad351a4f55838316994f9c2784b028fa9e5894b86cdd09234 WatchSource:0}: Error finding container 7f79db8da7ac8f5ad351a4f55838316994f9c2784b028fa9e5894b86cdd09234: Status 404 returned error can't find the container with id 7f79db8da7ac8f5ad351a4f55838316994f9c2784b028fa9e5894b86cdd09234
Jul 17 14:50:20.304203 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.304184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sppht" event={"ID":"119823c3-d23a-4430-bf25-b43af13da224","Type":"ContainerStarted","Data":"7f79db8da7ac8f5ad351a4f55838316994f9c2784b028fa9e5894b86cdd09234"}
Jul 17 14:50:20.376137 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.376106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mbnm"
Jul 17 14:50:20.407023 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:50:20.406998    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266d2302_bccf_4cfc_a4cd_58b44ccc8984.slice/crio-5cc68b7d249bbaeaa4b34d2d8c3aaa4970ae8c62e117547811728c28dad27432 WatchSource:0}: Error finding container 5cc68b7d249bbaeaa4b34d2d8c3aaa4970ae8c62e117547811728c28dad27432: Status 404 returned error can't find the container with id 5cc68b7d249bbaeaa4b34d2d8c3aaa4970ae8c62e117547811728c28dad27432
Jul 17 14:50:20.864102 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.864068    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-2qmwk"]
Jul 17 14:50:20.876095 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.876075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:20.876177 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:20.876135    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:20.907736 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.907711    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmxvk\" (UniqueName: \"kubernetes.io/projected/cd66ee5a-0971-4134-803c-8eab20c3c3d0-kube-api-access-dmxvk\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:20.907736 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:20.907741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:21.008066 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:21.008023    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmxvk\" (UniqueName: \"kubernetes.io/projected/cd66ee5a-0971-4134-803c-8eab20c3c3d0-kube-api-access-dmxvk\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:21.008220 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:21.008086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:21.008220 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:21.008192    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:21.008332 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:21.008255    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:21.508236222 +0000 UTC m=+34.706500546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:21.029245 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:21.029219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmxvk\" (UniqueName: \"kubernetes.io/projected/cd66ee5a-0971-4134-803c-8eab20c3c3d0-kube-api-access-dmxvk\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:21.209831 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:21.209743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:21.209986 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:21.209887    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:50:21.209986 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:21.209942    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:53.209924184 +0000 UTC m=+66.408188515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:50:21.229953 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:21.229923    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:21.230479 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:21.230024    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:21.307654 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:21.307618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerStarted","Data":"5cc68b7d249bbaeaa4b34d2d8c3aaa4970ae8c62e117547811728c28dad27432"}
Jul 17 14:50:21.512257 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:21.512179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:21.512404 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:21.512284    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:21.512404 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:21.512346    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:22.512328424 +0000 UTC m=+35.710592745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:22.226463 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:22.226432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:22.226650 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:22.226549    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:22.518235 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:22.518141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:22.518623 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:22.518309    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:22.518623 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:22.518362    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:24.518344376 +0000 UTC m=+37.716608695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:23.228944 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:23.228924    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:23.229090 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:23.229031    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:23.314114 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:23.314072    2561 generic.go:356] "Generic (PLEG): container finished" podID="266d2302-bccf-4cfc-a4cd-58b44ccc8984" containerID="83dc5e9614c964a0612cb2628f5ecf37e32784c12c2fafbcede90daba8e09e01" exitCode=0
Jul 17 14:50:23.314236 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:23.314117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerDied","Data":"83dc5e9614c964a0612cb2628f5ecf37e32784c12c2fafbcede90daba8e09e01"}
Jul 17 14:50:24.226129 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:24.226094    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:24.226652 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:24.226215    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:24.532436 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:24.532302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:24.532648 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:24.532455    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:24.532648 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:24.532516    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:28.532495629 +0000 UTC m=+41.730759947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:25.226933 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:25.226874    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:25.227377 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:25.227058    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:26.226742 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:26.226709    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:26.226960 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:26.226848    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:27.227458 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:27.227428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:27.228011 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:27.227973    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:28.226200 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:28.226168    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:28.226384 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:28.226301    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:28.556390 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:28.556310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:28.556825 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:28.556434    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:28.556825 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:28.556491    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:36.556477322 +0000 UTC m=+49.754741637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:29.226851 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:29.226823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:29.227026 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:29.226954    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:30.226411 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.226382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:30.226858 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:30.226499    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:30.724165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.724131    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-rk444"]
Jul 17 14:50:30.731107 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.731075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.736599 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.736562    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 14:50:30.736599 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.736588    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 14:50:30.736599 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.736589    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 14:50:30.736796 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.736570    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 14:50:30.736796 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.736717    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 14:50:30.738342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.737585    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6r5mr\""
Jul 17 14:50:30.738342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.737722    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 14:50:30.870158 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-slash\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870158 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-netd\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-kubelet\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-log-socket\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-ovn-kubernetes\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-bin\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-var-lib-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450308ff-43f1-4907-8b14-f1614f095b41-ovn-node-metrics-cert\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870378    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-ovn\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-node-log\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-systemd-units\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-env-overrides\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-netns\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-script-lib\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-systemd\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcll6\" (UniqueName: \"kubernetes.io/projected/450308ff-43f1-4907-8b14-f1614f095b41-kube-api-access-gcll6\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870944 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-config\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.870944 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.870688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-etc-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971420 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-etc-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-slash\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-netd\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-kubelet\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-log-socket\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-ovn-kubernetes\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-slash\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-ovn-kubernetes\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971587    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-log-socket\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-kubelet\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971556    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-netd\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-etc-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-bin\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971663    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-var-lib-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450308ff-43f1-4907-8b14-f1614f095b41-ovn-node-metrics-cert\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-ovn\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-bin\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-node-log\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-systemd-units\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-ovn\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971834    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-env-overrides\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-node-log\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.971986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-systemd-units\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971850    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-var-lib-openvswitch\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-netns\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-script-lib\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-systemd\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcll6\" (UniqueName: \"kubernetes.io/projected/450308ff-43f1-4907-8b14-f1614f095b41-kube-api-access-gcll6\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.972001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-config\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.971954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-netns\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.972150    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-systemd\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.972333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-env-overrides\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.972474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-script-lib\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.972747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.972561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-config\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.974580 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.974519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450308ff-43f1-4907-8b14-f1614f095b41-ovn-node-metrics-cert\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:30.985130 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:30.985107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcll6\" (UniqueName: \"kubernetes.io/projected/450308ff-43f1-4907-8b14-f1614f095b41-kube-api-access-gcll6\") pod \"ovnkube-node-rk444\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") " pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:31.041371 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:31.041344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:31.227075 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:31.226987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:31.227471 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:31.227132    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:31.454800 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:50:31.454768    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450308ff_43f1_4907_8b14_f1614f095b41.slice/crio-07b412e2a1c9c44129f535a3d72009903f3e544bcfc98520d45b71eb8ec1d432 WatchSource:0}: Error finding container 07b412e2a1c9c44129f535a3d72009903f3e544bcfc98520d45b71eb8ec1d432: Status 404 returned error can't find the container with id 07b412e2a1c9c44129f535a3d72009903f3e544bcfc98520d45b71eb8ec1d432
Jul 17 14:50:32.227057 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:32.226861    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:32.227226 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:32.227157    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:32.333621 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:32.333585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sppht" event={"ID":"119823c3-d23a-4430-bf25-b43af13da224","Type":"ContainerStarted","Data":"ecc00250a2bdccf334d98ce3630c1c5c87ae2a24ded428e5016057337ac6b5e2"}
Jul 17 14:50:32.336408 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:32.336282    2561 generic.go:356] "Generic (PLEG): container finished" podID="266d2302-bccf-4cfc-a4cd-58b44ccc8984" containerID="7be542d364ccd63cd403c07f767d08a4dbecfdedd1f665c3b468df467a7212b7" exitCode=0
Jul 17 14:50:32.336408 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:32.336361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerDied","Data":"7be542d364ccd63cd403c07f767d08a4dbecfdedd1f665c3b468df467a7212b7"}
Jul 17 14:50:32.338154 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:32.338123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"07b412e2a1c9c44129f535a3d72009903f3e544bcfc98520d45b71eb8ec1d432"}
Jul 17 14:50:32.357399 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:32.357356    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sppht" podStartSLOduration=2.142116447 podStartE2EDuration="13.357343469s" totalImagesPullingTime="11.215227022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:32.35594861 +0000 UTC m=+45.554212948" watchObservedRunningTime="2026-07-17 14:50:32.357343469 +0000 UTC m=+45.555607810"
Jul 17 14:50:33.230506 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:33.230470    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:33.230956 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:33.230588    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:33.692326 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:33.691617    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-chs47"]
Jul 17 14:50:33.695016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:33.694612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:33.695016 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:33.694692    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:33.792330 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:33.792306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:33.892835 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:33.892811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:33.901198 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:33.901175    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 14:50:33.901296 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:33.901206    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 14:50:33.901296 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:33.901220    2561 projected.go:196] Error preparing data for projected volume kube-api-access-m2xvn for pod openshift-network-diagnostics/network-check-target-chs47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:33.901296 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:33.901287    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn podName:6e505f04-e1af-4120-97d6-7870f3648fcd nodeName:}" failed. No retries permitted until 2026-07-17 14:50:34.401269429 +0000 UTC m=+47.599533757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m2xvn" (UniqueName: "kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn") pod "network-check-target-chs47" (UID: "6e505f04-e1af-4120-97d6-7870f3648fcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:34.226271 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:34.226236    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:34.226425 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:34.226388    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:34.343947 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:34.343911    2561 generic.go:356] "Generic (PLEG): container finished" podID="266d2302-bccf-4cfc-a4cd-58b44ccc8984" containerID="e5b90d1505db7d61a45df39e91c75c077e6268dc3e3e7e67975659b3ebf43f29" exitCode=0
Jul 17 14:50:34.344312 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:34.343960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerDied","Data":"e5b90d1505db7d61a45df39e91c75c077e6268dc3e3e7e67975659b3ebf43f29"}
Jul 17 14:50:34.498232 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:34.498155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:34.498360 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:34.498292    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 14:50:34.498360 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:34.498311    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 14:50:34.498360 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:34.498320    2561 projected.go:196] Error preparing data for projected volume kube-api-access-m2xvn for pod openshift-network-diagnostics/network-check-target-chs47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:34.498460 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:34.498361    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn podName:6e505f04-e1af-4120-97d6-7870f3648fcd nodeName:}" failed. No retries permitted until 2026-07-17 14:50:35.498348776 +0000 UTC m=+48.696613092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2xvn" (UniqueName: "kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn") pod "network-check-target-chs47" (UID: "6e505f04-e1af-4120-97d6-7870f3648fcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:35.226209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:35.226179    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:35.226364 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:35.226304    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:35.226415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:35.226395    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:35.226523 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:35.226505    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:35.347806 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:35.347736    2561 generic.go:356] "Generic (PLEG): container finished" podID="266d2302-bccf-4cfc-a4cd-58b44ccc8984" containerID="4b239e094b7905989e050620d6a127b1470072daa29711a0bbcfd1ac59ebb6e9" exitCode=0
Jul 17 14:50:35.347806 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:35.347771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerDied","Data":"4b239e094b7905989e050620d6a127b1470072daa29711a0bbcfd1ac59ebb6e9"}
Jul 17 14:50:35.506506 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:35.506457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:35.506668 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:35.506609    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 14:50:35.506668 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:35.506629    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 14:50:35.506668 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:35.506639    2561 projected.go:196] Error preparing data for projected volume kube-api-access-m2xvn for pod openshift-network-diagnostics/network-check-target-chs47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:35.506806 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:35.506701    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn podName:6e505f04-e1af-4120-97d6-7870f3648fcd nodeName:}" failed. No retries permitted until 2026-07-17 14:50:37.50668569 +0000 UTC m=+50.704950022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2xvn" (UniqueName: "kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn") pod "network-check-target-chs47" (UID: "6e505f04-e1af-4120-97d6-7870f3648fcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:36.226848 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:36.226549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:36.226848 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:36.226662    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:36.616728 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:36.616617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:36.617198 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:36.616745    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:36.617198 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:36.616823    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:50:52.616800907 +0000 UTC m=+65.815065226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:37.053958 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.053925    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hgmtx"]
Jul 17 14:50:37.058367 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.057491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.065849 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.065586    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 14:50:37.065849 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.065699    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 14:50:37.065849 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.065776    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fsd6h\""
Jul 17 14:50:37.065849 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.065840    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 14:50:37.120205 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.119970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38627e2d-7240-4552-b1b1-821dba35c271-host-slash\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.120205 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.120057    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4lgg\" (UniqueName: \"kubernetes.io/projected/38627e2d-7240-4552-b1b1-821dba35c271-kube-api-access-k4lgg\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.120205 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.120100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38627e2d-7240-4552-b1b1-821dba35c271-iptables-alerter-script\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.220503 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.220468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38627e2d-7240-4552-b1b1-821dba35c271-host-slash\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.220661 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.220525    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4lgg\" (UniqueName: \"kubernetes.io/projected/38627e2d-7240-4552-b1b1-821dba35c271-kube-api-access-k4lgg\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.220661 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.220553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38627e2d-7240-4552-b1b1-821dba35c271-iptables-alerter-script\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.220929 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.220898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38627e2d-7240-4552-b1b1-821dba35c271-host-slash\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.221091 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.221067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38627e2d-7240-4552-b1b1-821dba35c271-iptables-alerter-script\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.229940 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.229920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:37.230069 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:37.230050    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:37.230139 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.230069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:37.230190 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:37.230170    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:37.240400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.240377    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4lgg\" (UniqueName: \"kubernetes.io/projected/38627e2d-7240-4552-b1b1-821dba35c271-kube-api-access-k4lgg\") pod \"iptables-alerter-hgmtx\" (UID: \"38627e2d-7240-4552-b1b1-821dba35c271\") " pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.369909 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.369839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hgmtx"
Jul 17 14:50:37.382030 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:50:37.382006    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38627e2d_7240_4552_b1b1_821dba35c271.slice/crio-b3a4b41d9fda8cfb3b465dbc3048dd5b7f350680ac579821f8985976a1cd6474 WatchSource:0}: Error finding container b3a4b41d9fda8cfb3b465dbc3048dd5b7f350680ac579821f8985976a1cd6474: Status 404 returned error can't find the container with id b3a4b41d9fda8cfb3b465dbc3048dd5b7f350680ac579821f8985976a1cd6474
Jul 17 14:50:37.522929 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:37.522889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:37.523132 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:37.523084    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 14:50:37.523132 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:37.523103    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 14:50:37.523132 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:37.523115    2561 projected.go:196] Error preparing data for projected volume kube-api-access-m2xvn for pod openshift-network-diagnostics/network-check-target-chs47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:37.523289 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:37.523174    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn podName:6e505f04-e1af-4120-97d6-7870f3648fcd nodeName:}" failed. No retries permitted until 2026-07-17 14:50:41.523153659 +0000 UTC m=+54.721417984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2xvn" (UniqueName: "kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn") pod "network-check-target-chs47" (UID: "6e505f04-e1af-4120-97d6-7870f3648fcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:38.226087 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:38.226056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:38.226545 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:38.226193    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:38.356809 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:38.356773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgmtx" event={"ID":"38627e2d-7240-4552-b1b1-821dba35c271","Type":"ContainerStarted","Data":"b3a4b41d9fda8cfb3b465dbc3048dd5b7f350680ac579821f8985976a1cd6474"}
Jul 17 14:50:39.227508 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:39.226952    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:39.227508 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:39.226958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:39.227508 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:39.227106    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:39.227508 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:39.227176    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:40.225923 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:40.225888    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:40.226118 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:40.226055    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:41.229473 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:41.229436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:41.229990 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:41.229436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:41.229990 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:41.229565    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:41.229990 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:41.229628    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:41.550443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:41.550358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:41.550611 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:41.550477    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 14:50:41.550611 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:41.550493    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 14:50:41.550611 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:41.550502    2561 projected.go:196] Error preparing data for projected volume kube-api-access-m2xvn for pod openshift-network-diagnostics/network-check-target-chs47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:41.550611 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:41.550552    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn podName:6e505f04-e1af-4120-97d6-7870f3648fcd nodeName:}" failed. No retries permitted until 2026-07-17 14:50:49.550538108 +0000 UTC m=+62.748802439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2xvn" (UniqueName: "kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn") pod "network-check-target-chs47" (UID: "6e505f04-e1af-4120-97d6-7870f3648fcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:42.226093 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:42.226056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:42.226339 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:42.226199    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:43.226117 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:43.226082    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:43.226117 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:43.226119    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:43.226615 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:43.226207    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:43.226615 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:43.226289    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:44.226201 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:44.226165    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:44.226635 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:44.226304    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:45.226261 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:45.226225    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:45.226573 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:45.226346    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:45.226573 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:45.226396    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:45.226573 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:45.226486    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:46.226230 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.226011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:46.226365 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:46.226268    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:46.374945 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.374916    2561 generic.go:356] "Generic (PLEG): container finished" podID="266d2302-bccf-4cfc-a4cd-58b44ccc8984" containerID="e924db6c215917a206c449903755736f6f2237814c94cc60199ca09e2e099a31" exitCode=0
Jul 17 14:50:46.375101 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.374992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerDied","Data":"e924db6c215917a206c449903755736f6f2237814c94cc60199ca09e2e099a31"}
Jul 17 14:50:46.377626 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.377610    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/0.log"
Jul 17 14:50:46.377922 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.377901    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="dc10e51752aebc29c0c764f95219d2e8a938b1af0ec5670b8f64d8b972af22f1" exitCode=1
Jul 17 14:50:46.377977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.377925    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c"}
Jul 17 14:50:46.377977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.377968    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a"}
Jul 17 14:50:46.378063 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.377999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc"}
Jul 17 14:50:46.378063 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.378027    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f"}
Jul 17 14:50:46.378132 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.378074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"dc10e51752aebc29c0c764f95219d2e8a938b1af0ec5670b8f64d8b972af22f1"}
Jul 17 14:50:46.378132 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:46.378104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832"}
Jul 17 14:50:47.227089 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:47.227060    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:47.227533 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:47.227138    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:47.227533 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:47.227196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:47.227533 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:47.227300    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:47.382631 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:47.382600    2561 generic.go:356] "Generic (PLEG): container finished" podID="266d2302-bccf-4cfc-a4cd-58b44ccc8984" containerID="a0ebfe6cef0b28f19ee0743992187f9c1740dc0fd8e320527fbacedc3781a4da" exitCode=0
Jul 17 14:50:47.382778 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:47.382648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerDied","Data":"a0ebfe6cef0b28f19ee0743992187f9c1740dc0fd8e320527fbacedc3781a4da"}
Jul 17 14:50:47.384105 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:47.384083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hgmtx" event={"ID":"38627e2d-7240-4552-b1b1-821dba35c271","Type":"ContainerStarted","Data":"eaa3b8246ab8c00156db5fae066cfb60b662737f57004afe9e02e01f7509d9b8"}
Jul 17 14:50:47.422892 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:47.422853    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hgmtx" podStartSLOduration=2.446154622 podStartE2EDuration="10.422842163s" totalImagesPullingTime="7.976687541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:47.422692667 +0000 UTC m=+60.620957006" watchObservedRunningTime="2026-07-17 14:50:47.422842163 +0000 UTC m=+60.621106501"
Jul 17 14:50:48.226617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:48.226454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:48.226733 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:48.226700    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:48.389192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:48.389162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" event={"ID":"266d2302-bccf-4cfc-a4cd-58b44ccc8984","Type":"ContainerStarted","Data":"dd87849eac35585f85c4d6cfd3a9a6993f4a8a763a1e87131f6f35c6962fc676"}
Jul 17 14:50:48.392427 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:48.392407    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/0.log"
Jul 17 14:50:48.392795 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:48.392779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a"}
Jul 17 14:50:48.414241 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:48.414201    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2mbnm" podStartSLOduration=5.669123843 podStartE2EDuration="28.414188939s" totalImagesPullingTime="22.745065096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:48.413896496 +0000 UTC m=+61.612160833" watchObservedRunningTime="2026-07-17 14:50:48.414188939 +0000 UTC m=+61.612453276"
Jul 17 14:50:49.226258 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:49.226230    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:49.226446 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:49.226236    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:49.226446 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:49.226321    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:49.226446 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:49.226397    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:49.615437 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:49.615364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:49.615761 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:49.615474    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 14:50:49.615761 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:49.615490    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 14:50:49.615761 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:49.615498    2561 projected.go:196] Error preparing data for projected volume kube-api-access-m2xvn for pod openshift-network-diagnostics/network-check-target-chs47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:49.615761 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:49.615547    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn podName:6e505f04-e1af-4120-97d6-7870f3648fcd nodeName:}" failed. No retries permitted until 2026-07-17 14:51:05.615529052 +0000 UTC m=+78.813793389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2xvn" (UniqueName: "kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn") pod "network-check-target-chs47" (UID: "6e505f04-e1af-4120-97d6-7870f3648fcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:50:50.225998 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.225979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:50.226110 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:50.226093    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:50.399690 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.399667    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/0.log"
Jul 17 14:50:50.400127 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.400101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7"}
Jul 17 14:50:50.400418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.400397    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:50.400517 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.400456    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:50.400517 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.400504    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:50.400671 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.400653    2561 scope.go:117] "RemoveContainer" containerID="dc10e51752aebc29c0c764f95219d2e8a938b1af0ec5670b8f64d8b972af22f1"
Jul 17 14:50:50.418002 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.417978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:50.418220 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:50.418206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:50:51.226532 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:51.226352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:51.226890 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:51.226369    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:51.226890 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:51.226616    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:51.226890 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:51.226669    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:51.404892 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:51.404867    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/0.log"
Jul 17 14:50:51.405228 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:51.405206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerStarted","Data":"4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46"}
Jul 17 14:50:51.434067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:51.434014    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podStartSLOduration=7.48157087 podStartE2EDuration="21.434003488s" totalImagesPullingTime="13.952432618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:50:51.432788226 +0000 UTC m=+64.631052563" watchObservedRunningTime="2026-07-17 14:50:51.434003488 +0000 UTC m=+64.632267825"
Jul 17 14:50:52.226813 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:52.226790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:52.227155 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:52.226883    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:52.637962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:52.637933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:52.638213 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:52.638085    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:52.638213 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:52.638138    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:24.638123285 +0000 UTC m=+97.836387601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:50:53.226780 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:53.226750    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:53.226960 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:53.226759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:53.226960 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:53.226833    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:53.226960 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:53.226912    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:53.241580 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:53.241555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:53.241679 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:53.241657    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 14:50:53.241716 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:53.241701    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret podName:593de47b-3614-4449-9ccb-a4b5343620a8 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:57.241687615 +0000 UTC m=+130.439951931 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret") pod "global-pull-secret-syncer-dwst6" (UID: "593de47b-3614-4449-9ccb-a4b5343620a8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 14:50:54.226755 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:54.226724    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:54.226905 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:54.226832    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:55.226014 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.225981    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:55.226394 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.225982    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:55.226394 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:55.226103    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:55.226394 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:55.226176    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:55.518556 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518474    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-rk444"]
Jul 17 14:50:55.518889 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518832    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-controller" containerID="cri-o://75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832" gracePeriod=30
Jul 17 14:50:55.518984 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518855    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="nbdb" containerID="cri-o://0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" gracePeriod=30
Jul 17 14:50:55.518984 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518908    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="northd" containerID="cri-o://2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a" gracePeriod=30
Jul 17 14:50:55.518984 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518869    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-ovn-metrics" containerID="cri-o://11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc" gracePeriod=30
Jul 17 14:50:55.518984 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518920    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-acl-logging" containerID="cri-o://4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46" gracePeriod=30
Jul 17 14:50:55.518984 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518970    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-node" containerID="cri-o://55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f" gracePeriod=30
Jul 17 14:50:55.519258 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.518933    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="sbdb" containerID="cri-o://7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" gracePeriod=30
Jul 17 14:50:55.537530 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.537495    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 17 14:50:55.543425 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:55.543283    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovnkube-controller" containerID="cri-o://38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7" gracePeriod=30
Jul 17 14:50:56.225999 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.225979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:56.226165 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:56.226099    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:56.417793 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.417770    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/1.log"
Jul 17 14:50:56.419483 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.419466    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-ovn-metrics/0.log"
Jul 17 14:50:56.419876 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.419863    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-node/0.log"
Jul 17 14:50:56.420219 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420204    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/0.log"
Jul 17 14:50:56.420588 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420575    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-controller/0.log"
Jul 17 14:50:56.420641 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420608    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46" exitCode=143
Jul 17 14:50:56.420641 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420622    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" exitCode=0
Jul 17 14:50:56.420641 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420630    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" exitCode=0
Jul 17 14:50:56.420641 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420635    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a" exitCode=0
Jul 17 14:50:56.420641 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420640    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc" exitCode=143
Jul 17 14:50:56.420783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420645    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f" exitCode=143
Jul 17 14:50:56.420783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420650    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832" exitCode=143
Jul 17 14:50:56.420783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46"}
Jul 17 14:50:56.420783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a"}
Jul 17 14:50:56.420783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420776    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c"}
Jul 17 14:50:56.420922 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420803    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a"}
Jul 17 14:50:56.420922 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420834    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc"}
Jul 17 14:50:56.420922 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420862    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f"}
Jul 17 14:50:56.420922 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.420888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832"}
Jul 17 14:50:56.431359 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:56.431345    2561 scope.go:117] "RemoveContainer" containerID="dc10e51752aebc29c0c764f95219d2e8a938b1af0ec5670b8f64d8b972af22f1"
Jul 17 14:50:57.226700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:57.226666    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:57.227064 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:57.226759    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:50:57.227064 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:57.226844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:57.227064 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:57.226943    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:57.424471 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:57.424450    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/1.log"
Jul 17 14:50:57.425997 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:57.425979    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-ovn-metrics/0.log"
Jul 17 14:50:57.426369 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:57.426356    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-node/0.log"
Jul 17 14:50:57.426725 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:57.426713    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-controller/0.log"
Jul 17 14:50:58.226306 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:58.226276    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:50:58.226461 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:58.226372    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:50:59.228563 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:59.228539    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:50:59.228990 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:50:59.228542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:50:59.228990 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:59.228625    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:50:59.228990 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:50:59.228697    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:00.226754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:00.226721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:00.226915 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.226824    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:00.400966 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.400913    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:00.401388 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.400916    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:00.401388 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.401270    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:00.401388 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.401287    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:00.401585 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.401557    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:00.401628 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.401598    2561 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="sbdb" probeResult="unknown"
Jul 17 14:51:00.401679 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.401564    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:00.401730 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:00.401688    2561 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="nbdb" probeResult="unknown"
Jul 17 14:51:01.225935 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:01.225910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:01.226119 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:01.225941    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:01.226119 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:01.226014    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:01.226119 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:01.226107    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:02.226530 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:02.226503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:02.226940 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:02.226619    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:03.225931 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:03.225895    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:03.226143 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:03.225901    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:03.226143 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:03.225991    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:03.226143 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:03.226112    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:04.226808 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:04.226774    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:04.227269 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:04.226986    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:05.226211 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:05.226182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:05.226211 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:05.226194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:05.226417 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:05.226274    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:05.226417 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:05.226391    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:05.631502 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:05.631476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:05.631824 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:05.631599    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 14:51:05.631824 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:05.631612    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 14:51:05.631824 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:05.631620    2561 projected.go:196] Error preparing data for projected volume kube-api-access-m2xvn for pod openshift-network-diagnostics/network-check-target-chs47: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:51:05.631824 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:05.631663    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn podName:6e505f04-e1af-4120-97d6-7870f3648fcd nodeName:}" failed. No retries permitted until 2026-07-17 14:51:37.631650751 +0000 UTC m=+110.829915067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m2xvn" (UniqueName: "kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn") pod "network-check-target-chs47" (UID: "6e505f04-e1af-4120-97d6-7870f3648fcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 14:51:06.226106 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:06.226079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:06.226268 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:06.226174    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:07.227603 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:07.227569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:07.228058 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:07.227637    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:07.230629 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:07.228242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:07.230629 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:07.228653    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:08.226636 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:08.226520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:08.226784 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:08.226734    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:09.226032 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:09.226003    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:09.226603 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:09.226115    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:09.226603 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:09.226196    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:09.226603 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:09.226273    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:10.226724 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:10.226683    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:10.227170 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.226812    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:10.400876 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.400830    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:10.401058 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.400838    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:10.401214 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.401192    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:10.401281 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.401189    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:10.401498 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.401469    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:10.401585 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.401513    2561 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="sbdb" probeResult="unknown"
Jul 17 14:51:10.401585 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.401474    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:10.401657 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:10.401587    2561 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="nbdb" probeResult="unknown"
Jul 17 14:51:11.226211 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:11.226185    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:11.226366 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:11.226301    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:11.226366 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:11.226346    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:11.226433 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:11.226417    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:12.226138 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:12.226106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:12.226565 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:12.226208    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:13.226340 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:13.226314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:13.226781 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:13.226314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:13.226781 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:13.226475    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:13.226781 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:13.226401    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:14.226779 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:14.226751    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:14.227177 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:14.226844    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:15.226286 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:15.226251    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:15.226455 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:15.226372    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:15.226455 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:15.226443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:15.226571 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:15.226549    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:16.226571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:16.226542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:16.227022 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:16.226868    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:17.227559 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:17.227525    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:17.227989 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:17.227619    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:17.227989 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:17.227714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:17.227989 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:17.227823    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:17.467886 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:17.467861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 14:51:17.468035 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:17.467895    2561 generic.go:356] "Generic (PLEG): container finished" podID="119823c3-d23a-4430-bf25-b43af13da224" containerID="ecc00250a2bdccf334d98ce3630c1c5c87ae2a24ded428e5016057337ac6b5e2" exitCode=1
Jul 17 14:51:17.468035 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:17.467923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sppht" event={"ID":"119823c3-d23a-4430-bf25-b43af13da224","Type":"ContainerDied","Data":"ecc00250a2bdccf334d98ce3630c1c5c87ae2a24ded428e5016057337ac6b5e2"}
Jul 17 14:51:17.468218 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:17.468206    2561 scope.go:117] "RemoveContainer" containerID="ecc00250a2bdccf334d98ce3630c1c5c87ae2a24ded428e5016057337ac6b5e2"
Jul 17 14:51:18.225927 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:18.225893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:18.226136 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:18.226014    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:18.472198 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:18.472172    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 14:51:18.472730 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:18.472219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sppht" event={"ID":"119823c3-d23a-4430-bf25-b43af13da224","Type":"ContainerStarted","Data":"5d3e053ebbaae67725261f2d629f2c5588c36bb63c9a72e6189056aae2796695"}
Jul 17 14:51:19.225916 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:19.225880    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:19.226126 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:19.225880    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:19.226126 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:19.225993    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:19.226126 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:19.226063    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:20.226765 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:20.226740    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:20.227140 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.226863    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:20.401250 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401207    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:20.401407 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401215    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:20.401521 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401500    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:20.401521 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401510    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:20.401773 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401744    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"nb\"\n"]
Jul 17 14:51:20.401833 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401781    2561 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="nbdb" probeResult="unknown"
Jul 17 14:51:20.401884 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401752    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a" cmd=["/bin/bash","-c","set -xeo pipefail\n. /ovnkube-lib/ovnkube-lib.sh || exit 1\novndb-readiness-probe \"sb\"\n"]
Jul 17 14:51:20.401938 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:20.401874    2561 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a is running failed: container process not found" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="sbdb" probeResult="unknown"
Jul 17 14:51:21.226230 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:21.226199    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:21.226230 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:21.226219    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:21.226472 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:21.226332    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:21.226472 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:21.226431    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:22.226001 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:22.225974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:22.226373 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:22.226084    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:23.226280 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:23.226241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:23.226724 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:23.226312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:23.226724 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:23.226417    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:23.226724 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:23.226531    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:24.226302 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:24.226268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:24.226725 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:24.226375    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:24.675586 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:24.675558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:24.675730 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:24.675696    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:51:24.675770 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:24.675750    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs podName:cd66ee5a-0971-4134-803c-8eab20c3c3d0 nodeName:}" failed. No retries permitted until 2026-07-17 14:52:28.675735105 +0000 UTC m=+161.873999421 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs") pod "network-metrics-daemon-2qmwk" (UID: "cd66ee5a-0971-4134-803c-8eab20c3c3d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 14:51:25.226000 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:25.225973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:25.226197 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:25.225973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:25.226197 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:25.226086    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:25.226197 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:25.226187    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:25.520566 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:25.520485    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7" cmd=["test","-f","/etc/cni/net.d/10-ovn-kubernetes.conf"]
Jul 17 14:51:25.521429 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:25.521398    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7" cmd=["test","-f","/etc/cni/net.d/10-ovn-kubernetes.conf"]
Jul 17 14:51:25.522220 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:25.522191    2561 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7" cmd=["test","-f","/etc/cni/net.d/10-ovn-kubernetes.conf"]
Jul 17 14:51:25.522305 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:25.522231    2561 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovnkube-controller" probeResult="unknown"
Jul 17 14:51:26.072033 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.072011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/1.log"
Jul 17 14:51:26.072524 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.072508    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovnkube-controller/0.log"
Jul 17 14:51:26.073837 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.073820    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-ovn-metrics/0.log"
Jul 17 14:51:26.074287 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.074272    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-node/0.log"
Jul 17 14:51:26.074686 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.074674    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-controller/0.log"
Jul 17 14:51:26.076974 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.076958    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:51:26.171901 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.171880    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-mtr8m"]
Jul 17 14:51:26.172004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.171994    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="nbdb"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172006    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="nbdb"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172014    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="sbdb"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172019    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="sbdb"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172024    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovnkube-controller"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172030    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovnkube-controller"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172053    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-node"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172058    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-node"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172064    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-ovn-metrics"
Jul 17 14:51:26.172067 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172070    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-ovn-metrics"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172076    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="northd"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172081    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="northd"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172086    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-acl-logging"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172091    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-acl-logging"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172097    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-controller"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172102    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-controller"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172130    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="nbdb"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172136    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="sbdb"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172141    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovnkube-controller"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172145    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-acl-logging"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172150    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-controller"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172155    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="northd"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172159    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-node"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172163    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="kube-rbac-proxy-ovn-metrics"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172186    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-acl-logging"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172191    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-acl-logging"
Jul 17 14:51:26.172331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.172216    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="450308ff-43f1-4907-8b14-f1614f095b41" containerName="ovn-acl-logging"
Jul 17 14:51:26.174848 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.174835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.189166 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189147    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-openvswitch\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189251 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-ovn\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189251 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189187    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-netd\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189251 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189203    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-log-socket\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189251 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189221    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-var-lib-openvswitch\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189251 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189243    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-systemd-units\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189251 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189243    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-ovn" (OuterVolumeSpecName: "run-ovn") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189259    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-openvswitch" (OuterVolumeSpecName: "run-openvswitch") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "run-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189275    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450308ff-43f1-4907-8b14-f1614f095b41-ovn-node-metrics-cert\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189272    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-log-socket" (OuterVolumeSpecName: "log-socket") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "log-socket". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189298    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-netns\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189289    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-systemd-units" (OuterVolumeSpecName: "systemd-units") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "systemd-units". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-netd" (OuterVolumeSpecName: "host-cni-netd") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "host-cni-netd". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189286    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-var-lib-openvswitch" (OuterVolumeSpecName: "var-lib-openvswitch") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "var-lib-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189317    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-netns" (OuterVolumeSpecName: "host-run-netns") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "host-run-netns". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189343    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-slash\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189362    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-kubelet\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189365    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-slash" (OuterVolumeSpecName: "host-slash") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "host-slash". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189387    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-script-lib\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189399    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-kubelet" (OuterVolumeSpecName: "host-kubelet") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "host-kubelet". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189406    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcll6\" (UniqueName: \"kubernetes.io/projected/450308ff-43f1-4907-8b14-f1614f095b41-kube-api-access-gcll6\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189424    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-ovn-kubernetes\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189448    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-bin\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.189522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189473    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-var-lib-cni-networks-ovn-kubernetes\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189497    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-etc-openvswitch\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189522    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-node-log\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189521    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-bin" (OuterVolumeSpecName: "host-cni-bin") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "host-cni-bin". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189552    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-node-log" (OuterVolumeSpecName: "node-log") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "node-log". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189548    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-systemd\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189601    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-config\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189521    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-ovn-kubernetes" (OuterVolumeSpecName: "host-run-ovn-kubernetes") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "host-run-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189534    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-var-lib-cni-networks-ovn-kubernetes" (OuterVolumeSpecName: "host-var-lib-cni-networks-ovn-kubernetes") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "host-var-lib-cni-networks-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189544    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-etc-openvswitch" (OuterVolumeSpecName: "etc-openvswitch") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "etc-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189625    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-env-overrides\") pod \"450308ff-43f1-4907-8b14-f1614f095b41\" (UID: \"450308ff-43f1-4907-8b14-f1614f095b41\") "
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189768    2561 reconciler_common.go:299] "Volume detached for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-openvswitch\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189785    2561 reconciler_common.go:299] "Volume detached for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-ovn\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189799    2561 reconciler_common.go:299] "Volume detached for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-netd\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189816    2561 reconciler_common.go:299] "Volume detached for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-log-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189829    2561 reconciler_common.go:299] "Volume detached for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-var-lib-openvswitch\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189843    2561 reconciler_common.go:299] "Volume detached for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-systemd-units\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189855    2561 reconciler_common.go:299] "Volume detached for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-netns\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189868    2561 reconciler_common.go:299] "Volume detached for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-slash\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189879    2561 reconciler_common.go:299] "Volume detached for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-kubelet\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189891    2561 reconciler_common.go:299] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-script-lib\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189895    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189906    2561 reconciler_common.go:299] "Volume detached for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-run-ovn-kubernetes\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189910    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189921    2561 reconciler_common.go:299] "Volume detached for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-cni-bin\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189933    2561 reconciler_common.go:299] "Volume detached for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-host-var-lib-cni-networks-ovn-kubernetes\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189942    2561 reconciler_common.go:299] "Volume detached for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-etc-openvswitch\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.190766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.189950    2561 reconciler_common.go:299] "Volume detached for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-node-log\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.192615 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.192485    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/450308ff-43f1-4907-8b14-f1614f095b41-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:51:26.192766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.192753    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/450308ff-43f1-4907-8b14-f1614f095b41-kube-api-access-gcll6" (OuterVolumeSpecName: "kube-api-access-gcll6") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "kube-api-access-gcll6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:51:26.193568 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.193553    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-systemd" (OuterVolumeSpecName: "run-systemd") pod "450308ff-43f1-4907-8b14-f1614f095b41" (UID: "450308ff-43f1-4907-8b14-f1614f095b41"). InnerVolumeSpecName "run-systemd". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 17 14:51:26.225974 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.225952    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:26.226082 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.226060    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:26.290276 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-var-lib-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290373 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-ovn\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290373 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-run-netns\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290373 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-etc-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290466 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-log-socket\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290466 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290466 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-node-log\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290466 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-systemd-units\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290466 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5f85f5-889a-4428-8e04-d558b0e76627-ovn-node-metrics-cert\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-kubelet\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-slash\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-ovnkube-config\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-cni-netd\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290581    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-systemd\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290596    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-ovnkube-script-lib\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/ad5f85f5-889a-4428-8e04-d558b0e76627-kube-api-access-v2xb2\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-cni-bin\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-env-overrides\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290830    2561 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-ovnkube-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290846    2561 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450308ff-43f1-4907-8b14-f1614f095b41-env-overrides\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290862    2561 reconciler_common.go:299] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450308ff-43f1-4907-8b14-f1614f095b41-ovn-node-metrics-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290877    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcll6\" (UniqueName: \"kubernetes.io/projected/450308ff-43f1-4907-8b14-f1614f095b41-kube-api-access-gcll6\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.290954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.290892    2561 reconciler_common.go:299] "Volume detached for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450308ff-43f1-4907-8b14-f1614f095b41-run-systemd\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:51:26.391331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391310    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-var-lib-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391338    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-ovn\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-run-netns\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-etc-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-log-socket\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-var-lib-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-run-netns\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-ovn\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-etc-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-node-log\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-node-log\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391487    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-log-socket\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-systemd-units\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5f85f5-889a-4428-8e04-d558b0e76627-ovn-node-metrics-cert\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-kubelet\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-slash\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-systemd-units\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-ovnkube-config\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-slash\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-kubelet\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-cni-netd\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.391708 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391666    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-openvswitch\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391686    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-cni-netd\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-systemd\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-ovnkube-script-lib\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/ad5f85f5-889a-4428-8e04-d558b0e76627-kube-api-access-v2xb2\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-run-systemd\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-cni-bin\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-env-overrides\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-run-ovn-kubernetes\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.391875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad5f85f5-889a-4428-8e04-d558b0e76627-host-cni-bin\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.392197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-env-overrides\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.392212    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-ovnkube-config\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.392562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.392382    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ad5f85f5-889a-4428-8e04-d558b0e76627-ovnkube-script-lib\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.394301 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.394285    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad5f85f5-889a-4428-8e04-d558b0e76627-ovn-node-metrics-cert\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.404485 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.404465    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xb2\" (UniqueName: \"kubernetes.io/projected/ad5f85f5-889a-4428-8e04-d558b0e76627-kube-api-access-v2xb2\") pod \"ovnkube-node-mtr8m\" (UID: \"ad5f85f5-889a-4428-8e04-d558b0e76627\") " pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.482415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.482396    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:26.488904 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.488887    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-acl-logging/1.log"
Jul 17 14:51:26.489364 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.489347    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovnkube-controller/0.log"
Jul 17 14:51:26.490763 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.490735    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-ovn-metrics/0.log"
Jul 17 14:51:26.491169 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.491156    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/kube-rbac-proxy-node/0.log"
Jul 17 14:51:26.491542 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.491530    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rk444_450308ff-43f1-4907-8b14-f1614f095b41/ovn-controller/0.log"
Jul 17 14:51:26.491597 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.491565    2561 generic.go:356] "Generic (PLEG): container finished" podID="450308ff-43f1-4907-8b14-f1614f095b41" containerID="38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7" exitCode=137
Jul 17 14:51:26.491642 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.491623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7"}
Jul 17 14:51:26.491688 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.491674    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rk444"
Jul 17 14:51:26.491721 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.491701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rk444" event={"ID":"450308ff-43f1-4907-8b14-f1614f095b41","Type":"ContainerDied","Data":"07b412e2a1c9c44129f535a3d72009903f3e544bcfc98520d45b71eb8ec1d432"}
Jul 17 14:51:26.491769 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.491758    2561 scope.go:117] "RemoveContainer" containerID="4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46"
Jul 17 14:51:26.493569 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:51:26.493549    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5f85f5_889a_4428_8e04_d558b0e76627.slice/crio-8a2fba54cca96480a13380114fe452a897cfaf8ae6b217ce82227754f87ecd15 WatchSource:0}: Error finding container 8a2fba54cca96480a13380114fe452a897cfaf8ae6b217ce82227754f87ecd15: Status 404 returned error can't find the container with id 8a2fba54cca96480a13380114fe452a897cfaf8ae6b217ce82227754f87ecd15
Jul 17 14:51:26.499752 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.499736    2561 scope.go:117] "RemoveContainer" containerID="38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7"
Jul 17 14:51:26.507287 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.507266    2561 scope.go:117] "RemoveContainer" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a"
Jul 17 14:51:26.515729 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.515704    2561 scope.go:117] "RemoveContainer" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c"
Jul 17 14:51:26.520900 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.520882    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-rk444"]
Jul 17 14:51:26.524248 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.524228    2561 scope.go:117] "RemoveContainer" containerID="2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a"
Jul 17 14:51:26.530496 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.530478    2561 scope.go:117] "RemoveContainer" containerID="11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc"
Jul 17 14:51:26.531115 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.531098    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-rk444"]
Jul 17 14:51:26.536307 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.536283    2561 scope.go:117] "RemoveContainer" containerID="55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f"
Jul 17 14:51:26.541681 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.541666    2561 scope.go:117] "RemoveContainer" containerID="75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832"
Jul 17 14:51:26.549285 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.548967    2561 scope.go:117] "RemoveContainer" containerID="4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46"
Jul 17 14:51:26.549285 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.549270    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46\": container with ID starting with 4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46 not found: ID does not exist" containerID="4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46"
Jul 17 14:51:26.549377 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.549305    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46"} err="failed to get container status \"4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46\": rpc error: code = NotFound desc = could not find container \"4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46\": container with ID starting with 4642d10e1cd29fa1797e8c8cc85718e7885a0a157f9a374f2d25d5918347cc46 not found: ID does not exist"
Jul 17 14:51:26.549377 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.549349    2561 scope.go:117] "RemoveContainer" containerID="38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7"
Jul 17 14:51:26.549621 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.549604    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7\": container with ID starting with 38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7 not found: ID does not exist" containerID="38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7"
Jul 17 14:51:26.549683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.549629    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7"} err="failed to get container status \"38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7\": rpc error: code = NotFound desc = could not find container \"38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7\": container with ID starting with 38d9402fe4ec8c912ff39d66fa8ce8d150a50d34f80b96058986da39baeb06d7 not found: ID does not exist"
Jul 17 14:51:26.549683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.549651    2561 scope.go:117] "RemoveContainer" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a"
Jul 17 14:51:26.549952 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.549930    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a\": container with ID starting with 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a not found: ID does not exist" containerID="7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a"
Jul 17 14:51:26.550077 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.549953    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a"} err="failed to get container status \"7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a\": rpc error: code = NotFound desc = could not find container \"7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a\": container with ID starting with 7731292ae733bfac7d830251b21d9a09c3884c8568a13848297f3c0d913e6c1a not found: ID does not exist"
Jul 17 14:51:26.550077 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.549967    2561 scope.go:117] "RemoveContainer" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c"
Jul 17 14:51:26.550250 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.550230    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c\": container with ID starting with 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c not found: ID does not exist" containerID="0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c"
Jul 17 14:51:26.550303 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.550256    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c"} err="failed to get container status \"0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c\": rpc error: code = NotFound desc = could not find container \"0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c\": container with ID starting with 0cd4205daf9e458eadbc3e85c2510feab7511fc4e47a080907ef901edbbe9f2c not found: ID does not exist"
Jul 17 14:51:26.550303 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.550276    2561 scope.go:117] "RemoveContainer" containerID="2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a"
Jul 17 14:51:26.550576 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.550554    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a\": container with ID starting with 2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a not found: ID does not exist" containerID="2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a"
Jul 17 14:51:26.550633 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.550586    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a"} err="failed to get container status \"2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a\": rpc error: code = NotFound desc = could not find container \"2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a\": container with ID starting with 2a5eaef592152698ce81305c76527852595dbf7ee656bd7eaba3cf88ea0b813a not found: ID does not exist"
Jul 17 14:51:26.550633 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.550609    2561 scope.go:117] "RemoveContainer" containerID="11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc"
Jul 17 14:51:26.550890 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.550873    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc\": container with ID starting with 11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc not found: ID does not exist" containerID="11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc"
Jul 17 14:51:26.550946 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.550895    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc"} err="failed to get container status \"11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc\": rpc error: code = NotFound desc = could not find container \"11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc\": container with ID starting with 11268ceeda9153cdb856e2629fd7a4ebafa77d57dc104fd436a379ec175b7fbc not found: ID does not exist"
Jul 17 14:51:26.550946 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.550908    2561 scope.go:117] "RemoveContainer" containerID="55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f"
Jul 17 14:51:26.551399 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.551379    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f\": container with ID starting with 55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f not found: ID does not exist" containerID="55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f"
Jul 17 14:51:26.551462 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.551406    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f"} err="failed to get container status \"55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f\": rpc error: code = NotFound desc = could not find container \"55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f\": container with ID starting with 55939d4651abf7ccbec8fca700e881af9b3cdd6fd935d6b944c71929edcc575f not found: ID does not exist"
Jul 17 14:51:26.551462 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.551424    2561 scope.go:117] "RemoveContainer" containerID="75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832"
Jul 17 14:51:26.551697 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:26.551677    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832\": container with ID starting with 75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832 not found: ID does not exist" containerID="75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832"
Jul 17 14:51:26.551770 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:26.551701    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832"} err="failed to get container status \"75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832\": rpc error: code = NotFound desc = could not find container \"75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832\": container with ID starting with 75ad1038b34f53c21335f020571619367c516b86b1d486c34c71e70b61490832 not found: ID does not exist"
Jul 17 14:51:27.226828 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.226801    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:27.226987 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:27.226888    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:27.227027 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.226978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:27.227136 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:27.227113    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:27.229076 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.229031    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="450308ff-43f1-4907-8b14-f1614f095b41" path="/var/lib/kubelet/pods/450308ff-43f1-4907-8b14-f1614f095b41/volumes"
Jul 17 14:51:27.496107 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.496020    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"9878b367f6fe56c5787ed0af34987d70aeb05a5e4447043f59a07a688170c17c"}
Jul 17 14:51:27.496267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.496109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"cec301b345a6804a2a5c9e9a5ad3b7d30de07f90232615cc64c18364acddf3ff"}
Jul 17 14:51:27.496267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.496152    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"f8d581ae912bafa92c84adcb145a2f58d3bd1b7095febf435a3a01c587c490e7"}
Jul 17 14:51:27.496267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.496194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"08a423420ad1c32caeec2ba1cfc66c776742d5efdf34b9c926e65cfd3a4fc8f7"}
Jul 17 14:51:27.496267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.496236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"9b3c4f33c0100bdf0b43698b3f5a1f6ddf82d491964244c5228f1101884b8531"}
Jul 17 14:51:27.496437 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.496278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"75e096a8a1b5d05a709b249f08375a7c30a1fa0c9162d8fe8cf39a2c9befa2c2"}
Jul 17 14:51:27.496437 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.496325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"8a2fba54cca96480a13380114fe452a897cfaf8ae6b217ce82227754f87ecd15"}
Jul 17 14:51:27.744806 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.744778    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-f9zk4"]
Jul 17 14:51:27.747691 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.747649    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.750242 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.750219    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 14:51:27.750503 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.750484    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 14:51:27.750566 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.750526    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m725j\""
Jul 17 14:51:27.801529 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.801489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zrg\" (UniqueName: \"kubernetes.io/projected/3a7966eb-275b-4b12-b0bd-5b15749728df-kube-api-access-p2zrg\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.801683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.801548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7966eb-275b-4b12-b0bd-5b15749728df-hosts-file\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.801683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.801572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7966eb-275b-4b12-b0bd-5b15749728df-tmp-dir\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.902787 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.902764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zrg\" (UniqueName: \"kubernetes.io/projected/3a7966eb-275b-4b12-b0bd-5b15749728df-kube-api-access-p2zrg\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.902926 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.902802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7966eb-275b-4b12-b0bd-5b15749728df-hosts-file\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.902926 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.902819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7966eb-275b-4b12-b0bd-5b15749728df-tmp-dir\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.902926 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.902896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a7966eb-275b-4b12-b0bd-5b15749728df-hosts-file\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.903097 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.903083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a7966eb-275b-4b12-b0bd-5b15749728df-tmp-dir\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:27.914374 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:27.914349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zrg\" (UniqueName: \"kubernetes.io/projected/3a7966eb-275b-4b12-b0bd-5b15749728df-kube-api-access-p2zrg\") pod \"node-resolver-f9zk4\" (UID: \"3a7966eb-275b-4b12-b0bd-5b15749728df\") " pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:28.056093 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:28.056011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9zk4"
Jul 17 14:51:28.065646 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:51:28.065623    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7966eb_275b_4b12_b0bd_5b15749728df.slice/crio-fc9dcb13a65002155b1450d461a1d76a0ab722bf76b8ba11138674736569f761 WatchSource:0}: Error finding container fc9dcb13a65002155b1450d461a1d76a0ab722bf76b8ba11138674736569f761: Status 404 returned error can't find the container with id fc9dcb13a65002155b1450d461a1d76a0ab722bf76b8ba11138674736569f761
Jul 17 14:51:28.226248 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:28.226222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:28.226363 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:28.226314    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:28.499714 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:28.499683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9zk4" event={"ID":"3a7966eb-275b-4b12-b0bd-5b15749728df","Type":"ContainerStarted","Data":"27c76005999e884cc70586208eeab69835730628adb4f97b8a1bc46ef90186e6"}
Jul 17 14:51:28.499852 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:28.499722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9zk4" event={"ID":"3a7966eb-275b-4b12-b0bd-5b15749728df","Type":"ContainerStarted","Data":"fc9dcb13a65002155b1450d461a1d76a0ab722bf76b8ba11138674736569f761"}
Jul 17 14:51:28.516099 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:28.516058    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f9zk4" podStartSLOduration=1.516027948 podStartE2EDuration="1.516027948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:28.51562575 +0000 UTC m=+101.713890089" watchObservedRunningTime="2026-07-17 14:51:28.516027948 +0000 UTC m=+101.714292286"
Jul 17 14:51:29.226172 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:29.226148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:29.226533 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:29.226148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:29.226533 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:29.226260    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:29.226533 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:29.226302    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:29.505086 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:29.505015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"a5f12d701a1e02eef646f9ed72d24f81fbe762056ab03cf2cfe4a718fae08b07"}
Jul 17 14:51:30.226709 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:30.226681    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:30.227076 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:30.226773    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:31.226800 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:31.226725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:31.227175 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:31.226837    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:31.227175 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:31.226873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:31.227175 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:31.226950    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:31.512663 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:31.512596    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" event={"ID":"ad5f85f5-889a-4428-8e04-d558b0e76627","Type":"ContainerStarted","Data":"1a9fd639d32258145ed7648a5273a80dcc1c2129303311ecd16ee90f1cca86de"}
Jul 17 14:51:31.512858 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:31.512835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:31.512993 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:31.512907    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:31.528218 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:31.528197    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:31.537927 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:31.537892    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m" podStartSLOduration=5.537881208 podStartE2EDuration="5.537881208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:31.537495586 +0000 UTC m=+104.735759924" watchObservedRunningTime="2026-07-17 14:51:31.537881208 +0000 UTC m=+104.736145545"
Jul 17 14:51:32.226850 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:32.226822    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:32.227261 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:32.226945    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:32.515151 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:32.515069    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:32.530331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:32.530305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:51:33.014559 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:33.014364    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dwst6"]
Jul 17 14:51:33.014662 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:33.014635    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:33.014732 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:33.014714    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:33.017295 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:33.017273    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chs47"]
Jul 17 14:51:33.017401 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:33.017359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:33.017456 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:33.017437    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:33.019954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:33.019930    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2qmwk"]
Jul 17 14:51:33.020083 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:33.020013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:33.020157 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:33.020097    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:34.226266 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:34.226235    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:34.226748 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:34.226341    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:35.226204 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:35.226173    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:35.226463 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:35.226173    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:35.226463 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:35.226341    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qmwk" podUID="cd66ee5a-0971-4134-803c-8eab20c3c3d0"
Jul 17 14:51:35.226463 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:35.226449    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-chs47" podUID="6e505f04-e1af-4120-97d6-7870f3648fcd"
Jul 17 14:51:36.226694 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:36.226657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:36.227147 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:36.226775    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dwst6" podUID="593de47b-3614-4449-9ccb-a4b5343620a8"
Jul 17 14:51:37.187953 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.187926    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-54.ec2.internal" event="NodeReady"
Jul 17 14:51:37.188125 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.188015    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 14:51:37.227690 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.227663    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:51:37.228087 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.227838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:37.230283 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.230259    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 14:51:37.230392 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.230370    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k8rtv\""
Jul 17 14:51:37.230392 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.230378    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7594c\""
Jul 17 14:51:37.230392 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.230384    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 14:51:37.230541 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.230370    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 14:51:37.256298 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.256279    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68bddc45fc-prgfj"]
Jul 17 14:51:37.259097 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.259079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.261314 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.261295    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 14:51:37.261508 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.261493    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 14:51:37.261604 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.261531    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mdwrv\""
Jul 17 14:51:37.261716 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.261699    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 14:51:37.267148 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.267132    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 14:51:37.271302 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.271286    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sr5qp"]
Jul 17 14:51:37.273870 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.273851    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vd75z"]
Jul 17 14:51:37.273996 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.273978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.276459 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.276441    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68bddc45fc-prgfj"]
Jul 17 14:51:37.276555 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.276528    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.276775 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.276743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hxssw\""
Jul 17 14:51:37.276912 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.276897    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 14:51:37.276996 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.276982    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 14:51:37.278738 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.278719    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 14:51:37.279186 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.279165    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kbfbg\""
Jul 17 14:51:37.279284 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.279175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 14:51:37.279284 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.279258    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 14:51:37.284197 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.284171    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vd75z"]
Jul 17 14:51:37.288100 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.288083    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sr5qp"]
Jul 17 14:51:37.370147 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-trusted-ca\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.370263 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-config-volume\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.370263 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.370263 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqx5b\" (UniqueName: \"kubernetes.io/projected/2df39284-4e0b-4963-8975-e5343be7e400-kube-api-access-rqx5b\") pod \"ingress-canary-vd75z\" (UID: \"2df39284-4e0b-4963-8975-e5343be7e400\") " pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.370263 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.370417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fffb8d1d-842b-491d-b9a2-bc739341fe1d-ca-trust-extracted\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.370417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-bound-sa-token\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.370417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9lkq\" (UniqueName: \"kubernetes.io/projected/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-kube-api-access-w9lkq\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.370417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-image-registry-private-configuration\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.370417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdb6v\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-kube-api-access-wdb6v\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.370417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2df39284-4e0b-4963-8975-e5343be7e400-cert\") pod \"ingress-canary-vd75z\" (UID: \"2df39284-4e0b-4963-8975-e5343be7e400\") " pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.370611 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-installation-pull-secrets\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.370611 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-tmp-dir\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.370611 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.370546    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-certificates\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471292 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471292 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fffb8d1d-842b-491d-b9a2-bc739341fe1d-ca-trust-extracted\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471292 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-bound-sa-token\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471450 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9lkq\" (UniqueName: \"kubernetes.io/projected/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-kube-api-access-w9lkq\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.471450 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.471396    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 14:51:37.471450 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.471409    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bddc45fc-prgfj: secret "image-registry-tls" not found
Jul 17 14:51:37.471450 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-image-registry-private-configuration\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471601 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.471472    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls podName:fffb8d1d-842b-491d-b9a2-bc739341fe1d nodeName:}" failed. No retries permitted until 2026-07-17 14:51:37.971452544 +0000 UTC m=+111.169716870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls") pod "image-registry-68bddc45fc-prgfj" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d") : secret "image-registry-tls" not found
Jul 17 14:51:37.471601 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdb6v\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-kube-api-access-wdb6v\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471601 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2df39284-4e0b-4963-8975-e5343be7e400-cert\") pod \"ingress-canary-vd75z\" (UID: \"2df39284-4e0b-4963-8975-e5343be7e400\") " pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.471754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fffb8d1d-842b-491d-b9a2-bc739341fe1d-ca-trust-extracted\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-installation-pull-secrets\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-tmp-dir\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.471754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-certificates\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.471754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-trusted-ca\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.472004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-config-volume\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.472004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.472004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.471819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqx5b\" (UniqueName: \"kubernetes.io/projected/2df39284-4e0b-4963-8975-e5343be7e400-kube-api-access-rqx5b\") pod \"ingress-canary-vd75z\" (UID: \"2df39284-4e0b-4963-8975-e5343be7e400\") " pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.472164 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.472025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-tmp-dir\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.472164 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.472115    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 14:51:37.472256 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.472177    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls podName:29aa64f3-12a0-4ee6-8135-608dfe4baf1f nodeName:}" failed. No retries permitted until 2026-07-17 14:51:37.972162787 +0000 UTC m=+111.170427103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls") pod "dns-default-sr5qp" (UID: "29aa64f3-12a0-4ee6-8135-608dfe4baf1f") : secret "dns-default-metrics-tls" not found
Jul 17 14:51:37.472431 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.472410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-config-volume\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.472809 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.472784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-certificates\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.472906 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.472838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-trusted-ca\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.474806 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.474784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2df39284-4e0b-4963-8975-e5343be7e400-cert\") pod \"ingress-canary-vd75z\" (UID: \"2df39284-4e0b-4963-8975-e5343be7e400\") " pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.474880 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.474836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-installation-pull-secrets\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.474979 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.474958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-image-registry-private-configuration\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.481682 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.481636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqx5b\" (UniqueName: \"kubernetes.io/projected/2df39284-4e0b-4963-8975-e5343be7e400-kube-api-access-rqx5b\") pod \"ingress-canary-vd75z\" (UID: \"2df39284-4e0b-4963-8975-e5343be7e400\") " pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.481796 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.481780    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-bound-sa-token\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.482528 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.482504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdb6v\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-kube-api-access-wdb6v\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.482618 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.482601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9lkq\" (UniqueName: \"kubernetes.io/projected/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-kube-api-access-w9lkq\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.591245 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.591217    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vd75z"
Jul 17 14:51:37.674570 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.674535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:37.677690 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.677669    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xvn\" (UniqueName: \"kubernetes.io/projected/6e505f04-e1af-4120-97d6-7870f3648fcd-kube-api-access-m2xvn\") pod \"network-check-target-chs47\" (UID: \"6e505f04-e1af-4120-97d6-7870f3648fcd\") " pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:37.719294 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.719271    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vd75z"]
Jul 17 14:51:37.722438 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:51:37.722386    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df39284_4e0b_4963_8975_e5343be7e400.slice/crio-e92c5bcda30e8225c3f659ce95811cc86e5afd3e22cc2f9652d4c96a88b40745 WatchSource:0}: Error finding container e92c5bcda30e8225c3f659ce95811cc86e5afd3e22cc2f9652d4c96a88b40745: Status 404 returned error can't find the container with id e92c5bcda30e8225c3f659ce95811cc86e5afd3e22cc2f9652d4c96a88b40745
Jul 17 14:51:37.828676 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.828638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:37.842751 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.842731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:37.927413 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.927387    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:37.977684 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.977619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:37.977684 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.977660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:37.977820 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.977771    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 14:51:37.977820 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.977775    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 14:51:37.977820 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.977792    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bddc45fc-prgfj: secret "image-registry-tls" not found
Jul 17 14:51:37.977913 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.977830    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls podName:29aa64f3-12a0-4ee6-8135-608dfe4baf1f nodeName:}" failed. No retries permitted until 2026-07-17 14:51:38.977815051 +0000 UTC m=+112.176079367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls") pod "dns-default-sr5qp" (UID: "29aa64f3-12a0-4ee6-8135-608dfe4baf1f") : secret "dns-default-metrics-tls" not found
Jul 17 14:51:37.977913 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:37.977843    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls podName:fffb8d1d-842b-491d-b9a2-bc739341fe1d nodeName:}" failed. No retries permitted until 2026-07-17 14:51:38.97783774 +0000 UTC m=+112.176102056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls") pod "image-registry-68bddc45fc-prgfj" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d") : secret "image-registry-tls" not found
Jul 17 14:51:37.982410 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:37.982385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-chs47"]
Jul 17 14:51:37.986196 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:51:37.986177    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e505f04_e1af_4120_97d6_7870f3648fcd.slice/crio-383a66078b59245e77250b4290046d25dc2fcc184e7ca4644896532b5513cba9 WatchSource:0}: Error finding container 383a66078b59245e77250b4290046d25dc2fcc184e7ca4644896532b5513cba9: Status 404 returned error can't find the container with id 383a66078b59245e77250b4290046d25dc2fcc184e7ca4644896532b5513cba9
Jul 17 14:51:38.226731 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.226698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:38.229581 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.229527    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 14:51:38.533348 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.533210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chs47" event={"ID":"6e505f04-e1af-4120-97d6-7870f3648fcd","Type":"ContainerStarted","Data":"383a66078b59245e77250b4290046d25dc2fcc184e7ca4644896532b5513cba9"}
Jul 17 14:51:38.534778 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.534748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vd75z" event={"ID":"2df39284-4e0b-4963-8975-e5343be7e400","Type":"ContainerStarted","Data":"e92c5bcda30e8225c3f659ce95811cc86e5afd3e22cc2f9652d4c96a88b40745"}
Jul 17 14:51:38.841824 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.841713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:38.947771 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.947738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:38.986231 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.986206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:38.986394 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:38.986246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:38.986394 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:38.986384    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 14:51:38.986507 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:38.986399    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bddc45fc-prgfj: secret "image-registry-tls" not found
Jul 17 14:51:38.986507 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:38.986453    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls podName:fffb8d1d-842b-491d-b9a2-bc739341fe1d nodeName:}" failed. No retries permitted until 2026-07-17 14:51:40.986435429 +0000 UTC m=+114.184699758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls") pod "image-registry-68bddc45fc-prgfj" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d") : secret "image-registry-tls" not found
Jul 17 14:51:38.986751 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:38.986717    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 14:51:38.986859 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:38.986788    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls podName:29aa64f3-12a0-4ee6-8135-608dfe4baf1f nodeName:}" failed. No retries permitted until 2026-07-17 14:51:40.98677097 +0000 UTC m=+114.185035287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls") pod "dns-default-sr5qp" (UID: "29aa64f3-12a0-4ee6-8135-608dfe4baf1f") : secret "dns-default-metrics-tls" not found
Jul 17 14:51:39.280955 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:39.280907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:41.002066 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.002014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:41.002494 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.002073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:41.002494 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:41.002168    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 14:51:41.002494 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:41.002232    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls podName:29aa64f3-12a0-4ee6-8135-608dfe4baf1f nodeName:}" failed. No retries permitted until 2026-07-17 14:51:45.002216398 +0000 UTC m=+118.200480734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls") pod "dns-default-sr5qp" (UID: "29aa64f3-12a0-4ee6-8135-608dfe4baf1f") : secret "dns-default-metrics-tls" not found
Jul 17 14:51:41.002494 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:41.002233    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 14:51:41.002494 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:41.002257    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bddc45fc-prgfj: secret "image-registry-tls" not found
Jul 17 14:51:41.002494 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:41.002318    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls podName:fffb8d1d-842b-491d-b9a2-bc739341fe1d nodeName:}" failed. No retries permitted until 2026-07-17 14:51:45.002300062 +0000 UTC m=+118.200564401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls") pod "image-registry-68bddc45fc-prgfj" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d") : secret "image-registry-tls" not found
Jul 17 14:51:41.458400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.458366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:41.537989 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.537922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:41.544861 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.544831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-chs47" event={"ID":"6e505f04-e1af-4120-97d6-7870f3648fcd","Type":"ContainerStarted","Data":"fb93a4eb55b59eb78cadd3a92f14e7c6d3d0e8f2d3a3d5a3f790e9c23d61199a"}
Jul 17 14:51:41.544997 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.544901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:51:41.546219 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.546195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vd75z" event={"ID":"2df39284-4e0b-4963-8975-e5343be7e400","Type":"ContainerStarted","Data":"d9f1c9bc084f8264970dd2633c9d6f9104fe8634fdef9dff7b0c7c2ef174e11e"}
Jul 17 14:51:41.561818 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.561780    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-chs47" podStartSLOduration=65.362960109 podStartE2EDuration="1m8.561766886s" totalImagesPullingTime="3.198806777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:41.561144796 +0000 UTC m=+114.759409134" watchObservedRunningTime="2026-07-17 14:51:41.561766886 +0000 UTC m=+114.760031224"
Jul 17 14:51:41.576657 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:41.576624    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vd75z" podStartSLOduration=1.156888276 podStartE2EDuration="4.576611475s" totalImagesPullingTime="3.419723199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:51:41.576382779 +0000 UTC m=+114.774647129" watchObservedRunningTime="2026-07-17 14:51:41.576611475 +0000 UTC m=+114.774875815"
Jul 17 14:51:45.032383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:45.032348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:45.032383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:45.032391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:45.032783 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:45.032483    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 14:51:45.032783 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:45.032487    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 14:51:45.032783 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:45.032495    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bddc45fc-prgfj: secret "image-registry-tls" not found
Jul 17 14:51:45.032783 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:45.032552    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls podName:fffb8d1d-842b-491d-b9a2-bc739341fe1d nodeName:}" failed. No retries permitted until 2026-07-17 14:51:53.032537088 +0000 UTC m=+126.230801426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls") pod "image-registry-68bddc45fc-prgfj" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d") : secret "image-registry-tls" not found
Jul 17 14:51:45.032783 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:45.032564    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls podName:29aa64f3-12a0-4ee6-8135-608dfe4baf1f nodeName:}" failed. No retries permitted until 2026-07-17 14:51:53.032558336 +0000 UTC m=+126.230822652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls") pod "dns-default-sr5qp" (UID: "29aa64f3-12a0-4ee6-8135-608dfe4baf1f") : secret "dns-default-metrics-tls" not found
Jul 17 14:51:45.592788 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:45.592743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:45.658630 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:45.658605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:50.670255 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:50.670193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:50.786101 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:50.786066    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.045670 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.045589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.046340 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.046319    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zqn8g"]
Jul 17 14:51:51.050661 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.050646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.053117 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.053100    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 14:51:51.053330 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.053315    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 14:51:51.053403 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.053335    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 14:51:51.053403 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.053321    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 14:51:51.059946 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.059932    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rpvrl\""
Jul 17 14:51:51.068310 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.068292    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zqn8g"]
Jul 17 14:51:51.143689 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.143665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.171684 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.171650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-data-volume\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.171771 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.171699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.171771 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.171745    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.171870 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.171773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnt9d\" (UniqueName: \"kubernetes.io/projected/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-api-access-mnt9d\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.171870 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.171804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-crio-socket\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.272760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.272737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.272858 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.272764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.272858 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.272783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnt9d\" (UniqueName: \"kubernetes.io/projected/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-api-access-mnt9d\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.272858 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.272807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-crio-socket\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.273018 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.272863    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 14:51:51.273018 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.272891    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:51.273018 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.272930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-crio-socket\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.273018 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.272967    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:51.772950119 +0000 UTC m=+124.971214452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:51.273018 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.272992    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:51.772985172 +0000 UTC m=+124.971249489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : configmap "kube-rbac-proxy" not found
Jul 17 14:51:51.273272 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.273022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-data-volume\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.273308 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.273283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-data-volume\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.284705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.284685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnt9d\" (UniqueName: \"kubernetes.io/projected/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-api-access-mnt9d\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.335490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.335420    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.408440 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.408395    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.553925 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.553885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.654803 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.654767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.771974 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.771940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:51.777001 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.776985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.777089 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.777015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:51.777149 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.777123    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 14:51:51.777149 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.777144    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:51.777247 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.777192    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:52.777172264 +0000 UTC m=+125.975436608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : configmap "kube-rbac-proxy" not found
Jul 17 14:51:51.777247 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:51.777210    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:52.777201029 +0000 UTC m=+125.975465352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:51.877120 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:51.877094    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:52.030248 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:52.030178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:52.118215 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:52.118195    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:52.783315 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:52.783281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:52.783315 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:52.783318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:52.783752 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:52.783413    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 14:51:52.783752 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:52.783462    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:52.783752 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:52.783473    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:54.783457847 +0000 UTC m=+127.981722164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : configmap "kube-rbac-proxy" not found
Jul 17 14:51:52.783752 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:52.783516    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:54.783501341 +0000 UTC m=+127.981765671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:53.003720 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:53.003695    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9zk4_3a7966eb-275b-4b12-b0bd-5b15749728df/dns-node-resolver/0.log"
Jul 17 14:51:53.085823 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:53.085760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:51:53.085823 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:53.085789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:51:53.085992 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:53.085900    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 14:51:53.085992 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:53.085963    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls podName:29aa64f3-12a0-4ee6-8135-608dfe4baf1f nodeName:}" failed. No retries permitted until 2026-07-17 14:52:09.085949268 +0000 UTC m=+142.284213586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls") pod "dns-default-sr5qp" (UID: "29aa64f3-12a0-4ee6-8135-608dfe4baf1f") : secret "dns-default-metrics-tls" not found
Jul 17 14:51:53.085992 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:53.085903    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 14:51:53.086150 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:53.086002    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68bddc45fc-prgfj: secret "image-registry-tls" not found
Jul 17 14:51:53.086150 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:53.086084    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls podName:fffb8d1d-842b-491d-b9a2-bc739341fe1d nodeName:}" failed. No retries permitted until 2026-07-17 14:52:09.086066114 +0000 UTC m=+142.284330449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls") pod "image-registry-68bddc45fc-prgfj" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d") : secret "image-registry-tls" not found
Jul 17 14:51:53.703760 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:53.703731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:53.771614 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:53.771586    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:54.204871 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:54.204849    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xsllf_5e27ec93-6172-4179-9dfa-0f23b6ee274d/node-ca/0.log"
Jul 17 14:51:54.617371 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:54.617267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:54.797318 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:54.797291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:54.797430 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:54.797321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:54.797430 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:54.797402    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 14:51:54.797499 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:54.797457    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:58.797443035 +0000 UTC m=+131.995707352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : configmap "kube-rbac-proxy" not found
Jul 17 14:51:54.797499 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:54.797471    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:54.797564 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:54.797515    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:51:58.797499818 +0000 UTC m=+131.995764135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:55.004717 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:55.004697    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vd75z_2df39284-4e0b-4963-8975-e5343be7e400/serve-healthcheck-canary/0.log"
Jul 17 14:51:55.268531 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:55.268454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:55.664513 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:55.664467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:55.765195 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:55.765170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:55.867236 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:55.867199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:55.967824 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:55.967765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:56.252103 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:56.252009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:56.652148 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:56.652101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:57.254674 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.254645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:57.317588 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.317564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:57.320511 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.320495    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 14:51:57.330098 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.330079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/593de47b-3614-4449-9ccb-a4b5343620a8-original-pull-secret\") pod \"global-pull-secret-syncer-dwst6\" (UID: \"593de47b-3614-4449-9ccb-a4b5343620a8\") " pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:57.436022 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.435993    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dwst6"
Jul 17 14:51:57.558418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.558388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dwst6"]
Jul 17 14:51:57.561391 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:51:57.561367    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593de47b_3614_4449_9ccb_a4b5343620a8.slice/crio-1ceceae94041f701d59fa3d44c95823214889da80f28d9dfa402393000ceaec8 WatchSource:0}: Error finding container 1ceceae94041f701d59fa3d44c95823214889da80f28d9dfa402393000ceaec8: Status 404 returned error can't find the container with id 1ceceae94041f701d59fa3d44c95823214889da80f28d9dfa402393000ceaec8
Jul 17 14:51:57.582425 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.582401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dwst6" event={"ID":"593de47b-3614-4449-9ccb-a4b5343620a8","Type":"ContainerStarted","Data":"1ceceae94041f701d59fa3d44c95823214889da80f28d9dfa402393000ceaec8"}
Jul 17 14:51:57.660633 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.660604    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:57.852792 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:57.852702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:58.192819 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:58.192780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:58.452309 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:58.452207    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:58.595598 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:58.595567    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:58.696679 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:58.696642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:58.829807 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:58.829738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:58.829807 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:58.829770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:51:58.829983 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:58.829853    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 14:51:58.829983 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:58.829915    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:52:06.829899196 +0000 UTC m=+140.028163512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : configmap "kube-rbac-proxy" not found
Jul 17 14:51:58.829983 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:58.829925    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:58.829983 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:51:58.829972    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls podName:595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4 nodeName:}" failed. No retries permitted until 2026-07-17 14:52:06.829954586 +0000 UTC m=+140.028218902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zqn8g" (UID: "595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4") : secret "insights-runtime-extractor-tls" not found
Jul 17 14:51:59.162542 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:59.162514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:59.264554 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:59.264529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:59.399201 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:59.399140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:59.656016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:59.655976    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:51:59.758559 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:51:59.758527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:00.049234 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:00.049151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:00.258574 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:00.258542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:00.652436 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:00.652400    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:01.058215 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:01.058133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:01.845198 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:01.845166    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:02.010392 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:02.010362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:02.105832 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:02.105759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:02.451011 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:02.450980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:02.596400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:02.596369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dwst6" event={"ID":"593de47b-3614-4449-9ccb-a4b5343620a8","Type":"ContainerStarted","Data":"69ffe1768c54a401891db65bc4b4dea14d705422aced94f6e15008ebacee6016"}
Jul 17 14:52:02.614816 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:02.614772    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dwst6" podStartSLOduration=128.996454443 podStartE2EDuration="2m13.614755754s" totalImagesPullingTime="4.618301311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:02.614230458 +0000 UTC m=+135.812494796" watchObservedRunningTime="2026-07-17 14:52:02.614755754 +0000 UTC m=+135.813020095"
Jul 17 14:52:02.650621 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:02.650594    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:02.847679 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:02.847618    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:03.811509 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:03.811482    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:04.066590 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:04.066511    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:04.261642 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:04.261610    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:04.476211 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:04.476182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:04.530205 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:04.530180    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mtr8m"
Jul 17 14:52:04.652848 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:04.652820    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:04.865561 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:04.865485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:05.668404 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:05.668373    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:05.860342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:05.860303    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:06.048238 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:06.048162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:06.304486 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:06.304407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:06.899412 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:06.899374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:52:06.899412 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:06.899413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:52:06.899864 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:06.899843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:52:06.901827 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:06.901802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zqn8g\" (UID: \"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4\") " pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:52:06.959909 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:06.959888    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zqn8g"
Jul 17 14:52:07.081585 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:07.081556    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zqn8g"]
Jul 17 14:52:07.084216 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:07.084186    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595b8b32_e1ba_4d36_a8b9_e1da0d91d7f4.slice/crio-ec142a80f335e27751ab3e469d34e39d80024b4ec6932e672071bf77e8116454 WatchSource:0}: Error finding container ec142a80f335e27751ab3e469d34e39d80024b4ec6932e672071bf77e8116454: Status 404 returned error can't find the container with id ec142a80f335e27751ab3e469d34e39d80024b4ec6932e672071bf77e8116454
Jul 17 14:52:07.609826 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:07.609786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zqn8g" event={"ID":"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4","Type":"ContainerStarted","Data":"ec142a80f335e27751ab3e469d34e39d80024b4ec6932e672071bf77e8116454"}
Jul 17 14:52:07.931367 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:07.931318    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:07.999262 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:07.999228    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:09.117985 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.117955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:52:09.118466 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.117996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:52:09.120857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.120829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29aa64f3-12a0-4ee6-8135-608dfe4baf1f-metrics-tls\") pod \"dns-default-sr5qp\" (UID: \"29aa64f3-12a0-4ee6-8135-608dfe4baf1f\") " pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:52:09.120991 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.120898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"image-registry-68bddc45fc-prgfj\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") " pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:52:09.370298 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.370231    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mdwrv\""
Jul 17 14:52:09.377302 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.377270    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:52:09.387731 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.387696    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hxssw\""
Jul 17 14:52:09.395117 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.395093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:52:09.971877 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:09.971837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:10.034050 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:10.034004    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:11.013308 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:11.013282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:11.115522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:11.115484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:11.178791 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:11.178753    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:11.331323 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:11.331252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:11.689258 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:11.689226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:11.906883 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:11.906860    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68bddc45fc-prgfj"]
Jul 17 14:52:11.909694 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:11.909658    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffb8d1d_842b_491d_b9a2_bc739341fe1d.slice/crio-884cc581968dbfbc99ad167fdcb0dec0a87a585feb0ba09cb7a0978423c17c9d WatchSource:0}: Error finding container 884cc581968dbfbc99ad167fdcb0dec0a87a585feb0ba09cb7a0978423c17c9d: Status 404 returned error can't find the container with id 884cc581968dbfbc99ad167fdcb0dec0a87a585feb0ba09cb7a0978423c17c9d
Jul 17 14:52:11.918735 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:11.918633    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sr5qp"]
Jul 17 14:52:11.921109 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:11.921085    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29aa64f3_12a0_4ee6_8135_608dfe4baf1f.slice/crio-ed521c1f00b8f8d1c668e3efd4ebb78a083edd4793379d9cb11e5297e996353f WatchSource:0}: Error finding container ed521c1f00b8f8d1c668e3efd4ebb78a083edd4793379d9cb11e5297e996353f: Status 404 returned error can't find the container with id ed521c1f00b8f8d1c668e3efd4ebb78a083edd4793379d9cb11e5297e996353f
Jul 17 14:52:12.111699 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.111669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:12.183588 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.183556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:12.340826 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.340749    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:12.400810 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.400738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:12.553024 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.552245    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-chs47"
Jul 17 14:52:12.628074 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.627963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zqn8g" event={"ID":"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4","Type":"ContainerStarted","Data":"ba7839f2a25b2584d0a705340613a8a277bc72a9fee30d7e1a93eca2173e5e03"}
Jul 17 14:52:12.629577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.629514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr5qp" event={"ID":"29aa64f3-12a0-4ee6-8135-608dfe4baf1f","Type":"ContainerStarted","Data":"ed521c1f00b8f8d1c668e3efd4ebb78a083edd4793379d9cb11e5297e996353f"}
Jul 17 14:52:12.631326 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.631301    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj" event={"ID":"fffb8d1d-842b-491d-b9a2-bc739341fe1d","Type":"ContainerStarted","Data":"acc4c5112af3be3a3e1a1781f8206e33bdbd13fa9fc362c9362f6f1db9f2a6a9"}
Jul 17 14:52:12.631430 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.631345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj" event={"ID":"fffb8d1d-842b-491d-b9a2-bc739341fe1d","Type":"ContainerStarted","Data":"884cc581968dbfbc99ad167fdcb0dec0a87a585feb0ba09cb7a0978423c17c9d"}
Jul 17 14:52:12.631642 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.631623    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:52:12.706257 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.706222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:12.879867 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.879720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:12.981167 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:12.981124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:14.338105 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:14.338065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:14.437800 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:14.437764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:14.562681 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:14.562648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:14.941815 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:14.941767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:15.642070 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:15.642019    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zqn8g" event={"ID":"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4","Type":"ContainerStarted","Data":"cad69bc1917a50d61e4a6ccf3ed7a75ba3ebf42892d084f49e5dd1cc5ad8a5de"}
Jul 17 14:52:15.644094 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:15.644069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr5qp" event={"ID":"29aa64f3-12a0-4ee6-8135-608dfe4baf1f","Type":"ContainerStarted","Data":"fed11ecbf6129f05c90b83ee581c6feb0f13fee4c1198bb3736e0bcd820b0696"}
Jul 17 14:52:15.724694 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:15.724667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:16.650213 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:16.650180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sr5qp" event={"ID":"29aa64f3-12a0-4ee6-8135-608dfe4baf1f","Type":"ContainerStarted","Data":"9661d2548e3b60592d27653c434a26543661b207e1b78ebf8057ba3ebf196d9b"}
Jul 17 14:52:16.650641 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:16.650326    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:52:16.675573 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:16.675478    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj" podStartSLOduration=125.67546083 podStartE2EDuration="2m5.67546083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:12.654600686 +0000 UTC m=+145.852865024" watchObservedRunningTime="2026-07-17 14:52:16.67546083 +0000 UTC m=+149.873725169"
Jul 17 14:52:16.676227 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:16.676156    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sr5qp" podStartSLOduration=36.069157692 podStartE2EDuration="39.676146524s" totalImagesPullingTime="3.606988832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:16.674916164 +0000 UTC m=+149.873180501" watchObservedRunningTime="2026-07-17 14:52:16.676146524 +0000 UTC m=+149.874410840"
Jul 17 14:52:17.260620 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.260585    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"]
Jul 17 14:52:17.263636 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.263609    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"
Jul 17 14:52:17.278160 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.278122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/250750ee-675c-4c0b-88f1-3af126e658a3-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-x5vs5\" (UID: \"250750ee-675c-4c0b-88f1-3af126e658a3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"
Jul 17 14:52:17.283989 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.283966    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t2tbx\""
Jul 17 14:52:17.285030 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.285009    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 17 14:52:17.337564 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.337531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:17.378464 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.378437    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/250750ee-675c-4c0b-88f1-3af126e658a3-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-x5vs5\" (UID: \"250750ee-675c-4c0b-88f1-3af126e658a3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"
Jul 17 14:52:17.381327 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.381307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/250750ee-675c-4c0b-88f1-3af126e658a3-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-x5vs5\" (UID: \"250750ee-675c-4c0b-88f1-3af126e658a3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"
Jul 17 14:52:17.392136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.392115    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"]
Jul 17 14:52:17.449658 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.449625    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:17.573255 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:17.573180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"
Jul 17 14:52:18.169762 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:18.169710    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:18.253769 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:18.253736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:19.162159 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:19.162135    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"]
Jul 17 14:52:19.164385 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:19.164361    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250750ee_675c_4c0b_88f1_3af126e658a3.slice/crio-15a2385eeee9df4f3271baeef825058fcc5dc3e7ed53b154f4a196bd2e15da26 WatchSource:0}: Error finding container 15a2385eeee9df4f3271baeef825058fcc5dc3e7ed53b154f4a196bd2e15da26: Status 404 returned error can't find the container with id 15a2385eeee9df4f3271baeef825058fcc5dc3e7ed53b154f4a196bd2e15da26
Jul 17 14:52:19.661704 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:19.661667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zqn8g" event={"ID":"595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4","Type":"ContainerStarted","Data":"8ac16e575a53985d50583f007545d25447d5c906d83d1b4b7de0a8d8644aed95"}
Jul 17 14:52:19.662794 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:19.662773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5" event={"ID":"250750ee-675c-4c0b-88f1-3af126e658a3","Type":"ContainerStarted","Data":"15a2385eeee9df4f3271baeef825058fcc5dc3e7ed53b154f4a196bd2e15da26"}
Jul 17 14:52:19.678351 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:19.678302    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zqn8g" podStartSLOduration=16.783578203 podStartE2EDuration="28.678288092s" totalImagesPullingTime="11.894709889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:51:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:19.677182554 +0000 UTC m=+152.875446892" watchObservedRunningTime="2026-07-17 14:52:19.678288092 +0000 UTC m=+152.876552429"
Jul 17 14:52:20.667198 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:20.667113    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5" event={"ID":"250750ee-675c-4c0b-88f1-3af126e658a3","Type":"ContainerStarted","Data":"7fbd36815a77c39472df44733b6981dc1fe55fec908b7d629bc4e9027057e583"}
Jul 17 14:52:20.689387 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:20.689341    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5" podStartSLOduration=2.465246093 podStartE2EDuration="3.689328102s" totalImagesPullingTime="1.224082009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:20.688227317 +0000 UTC m=+153.886491655" watchObservedRunningTime="2026-07-17 14:52:20.689328102 +0000 UTC m=+153.887592440"
Jul 17 14:52:21.670605 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:21.670580    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"
Jul 17 14:52:21.675007 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:21.674984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-x5vs5"
Jul 17 14:52:22.595921 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.595888    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:22.669116 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.669089    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-66clz"]
Jul 17 14:52:22.672200 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.672174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.676004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.675984    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 14:52:22.676136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.676021    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 14:52:22.676136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.675993    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 17 14:52:22.676136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.675985    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2495t\""
Jul 17 14:52:22.676136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.676071    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 14:52:22.676353 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.676052    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 17 14:52:22.678891 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.678870    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-66clz"]
Jul 17 14:52:22.679362 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.679339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:22.713216 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.713190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.713305 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.713221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.713305 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.713249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8rjh\" (UniqueName: \"kubernetes.io/projected/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-kube-api-access-x8rjh\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.713305 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.713266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.748177 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.748136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:22.813522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.813501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.813602 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.813530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.813602 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.813559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8rjh\" (UniqueName: \"kubernetes.io/projected/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-kube-api-access-x8rjh\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.813723 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.813707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.814267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.814244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:22.814447 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.814427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.815927 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.815910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.816010 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.815994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.823473 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.823449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8rjh\" (UniqueName: \"kubernetes.io/projected/3a2067a1-9fe3-438d-9eb4-1989f8a1020b-kube-api-access-x8rjh\") pod \"prometheus-operator-5945b5cfd-66clz\" (UID: \"3a2067a1-9fe3-438d-9eb4-1989f8a1020b\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:22.981719 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:22.981698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz"
Jul 17 14:52:23.107563 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:23.107534    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-66clz"]
Jul 17 14:52:23.110096 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:23.110070    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2067a1_9fe3_438d_9eb4_1989f8a1020b.slice/crio-fa9ed5914b23cfc370ea63c4ad84fd4dc5e93e50b0bfb6216168f3627a8282e6 WatchSource:0}: Error finding container fa9ed5914b23cfc370ea63c4ad84fd4dc5e93e50b0bfb6216168f3627a8282e6: Status 404 returned error can't find the container with id fa9ed5914b23cfc370ea63c4ad84fd4dc5e93e50b0bfb6216168f3627a8282e6
Jul 17 14:52:23.678784 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:23.678747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz" event={"ID":"3a2067a1-9fe3-438d-9eb4-1989f8a1020b","Type":"ContainerStarted","Data":"fa9ed5914b23cfc370ea63c4ad84fd4dc5e93e50b0bfb6216168f3627a8282e6"}
Jul 17 14:52:24.676700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:24.676618    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:24.682625 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:24.682597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz" event={"ID":"3a2067a1-9fe3-438d-9eb4-1989f8a1020b","Type":"ContainerStarted","Data":"9d586d1b90b9bfca754d07cf779b85feffe7c3b3d9275eeef7e80c3d6400ea43"}
Jul 17 14:52:24.682948 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:24.682656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz" event={"ID":"3a2067a1-9fe3-438d-9eb4-1989f8a1020b","Type":"ContainerStarted","Data":"e302189f0c4d1039f130d167c1421f0490d07569e252ecd8cd7d293f8068fb2b"}
Jul 17 14:52:24.699789 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:24.699744    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-66clz" podStartSLOduration=1.42281919 podStartE2EDuration="2.699730569s" totalImagesPullingTime="1.276911379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:24.699621372 +0000 UTC m=+157.897885711" watchObservedRunningTime="2026-07-17 14:52:24.699730569 +0000 UTC m=+157.897994907"
Jul 17 14:52:25.139786 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.139756    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-764b846bb7-9lh5j"]
Jul 17 14:52:25.142634 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.142616    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.142911 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.142841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:25.146003 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.145984    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 14:52:25.146123 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.145987    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f5x7f\""
Jul 17 14:52:25.146978 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.146957    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 14:52:25.147376 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.147353    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 14:52:25.147517 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.147362    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 14:52:25.147517 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.147403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 14:52:25.147517 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.147428    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 14:52:25.147517 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.147363    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 14:52:25.151917 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.151895    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 14:52:25.152136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.152118    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764b846bb7-9lh5j"]
Jul 17 14:52:25.207395 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.207372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:25.232192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.232176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-console-config\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.232294 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.232203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-serving-cert\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.232294 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.232224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-oauth-serving-cert\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.232294 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.232248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-oauth-config\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.232458 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.232345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwh68\" (UniqueName: \"kubernetes.io/projected/c7eab092-985a-47eb-af89-e930d45a4993-kube-api-access-mwh68\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.232458 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.232380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-service-ca\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.232458 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.232438    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-trusted-ca-bundle\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333239 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-oauth-serving-cert\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333325 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-oauth-config\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333325 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwh68\" (UniqueName: \"kubernetes.io/projected/c7eab092-985a-47eb-af89-e930d45a4993-kube-api-access-mwh68\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333325 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-service-ca\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333440 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333333    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-trusted-ca-bundle\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333440 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-console-config\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333544 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-serving-cert\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.333989 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.333970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-oauth-serving-cert\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.334175 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.334139    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-service-ca\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.334255 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.334179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-console-config\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.334301 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.334268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-trusted-ca-bundle\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.335852 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.335829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-oauth-config\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.335916 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.335904    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-serving-cert\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.342892 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.342873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwh68\" (UniqueName: \"kubernetes.io/projected/c7eab092-985a-47eb-af89-e930d45a4993-kube-api-access-mwh68\") pod \"console-764b846bb7-9lh5j\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") " pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.452210 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.452115    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:25.575316 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.575282    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-764b846bb7-9lh5j"]
Jul 17 14:52:25.578731 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:25.578703    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7eab092_985a_47eb_af89_e930d45a4993.slice/crio-a9603a3f8f01ce9d5cfc514131c847d86cd1d4a75e87f7ebe3aac4348f5dc188 WatchSource:0}: Error finding container a9603a3f8f01ce9d5cfc514131c847d86cd1d4a75e87f7ebe3aac4348f5dc188: Status 404 returned error can't find the container with id a9603a3f8f01ce9d5cfc514131c847d86cd1d4a75e87f7ebe3aac4348f5dc188
Jul 17 14:52:25.687170 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.687135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b846bb7-9lh5j" event={"ID":"c7eab092-985a-47eb-af89-e930d45a4993","Type":"ContainerStarted","Data":"a9603a3f8f01ce9d5cfc514131c847d86cd1d4a75e87f7ebe3aac4348f5dc188"}
Jul 17 14:52:25.709984 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.709933    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:25.810886 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:25.810865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:26.331112 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:26.331081    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:26.392628 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:26.392597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:26.655555 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:26.655529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sr5qp"
Jul 17 14:52:26.755222 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:26.755190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:26.962866 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:26.962792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:27.062577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.062542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:27.098660 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.098625    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"]
Jul 17 14:52:27.102960 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.102929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.106962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.106940    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 14:52:27.107147 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.107119    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 14:52:27.107256 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.107172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-29hk8\""
Jul 17 14:52:27.107256 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.107123    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 14:52:27.109675 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.109642    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6wgkr"]
Jul 17 14:52:27.112876 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.112857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.113477 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.113430    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"]
Jul 17 14:52:27.115544 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.115521    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 14:52:27.115680 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.115587    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 14:52:27.115680 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.115530    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bbgng\""
Jul 17 14:52:27.115801 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.115771    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 14:52:27.145812 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.145785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-tls\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.145920 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.145828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.145920 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.145853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.145920 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.145872    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.145920 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.145890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftht\" (UniqueName: \"kubernetes.io/projected/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-api-access-wftht\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.145928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-metrics-client-ca\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2b56\" (UniqueName: \"kubernetes.io/projected/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-kube-api-access-x2b56\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-wtmp\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-sys\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.146199 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-root\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.146583 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.146233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-textfile\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.170758 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.170734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:27.247186 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-tls\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247186 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247186 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftht\" (UniqueName: \"kubernetes.io/projected/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-api-access-wftht\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:27.247276    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-metrics-client-ca\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:27.247351    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-tls podName:5df2e55b-b7fe-48df-8eaa-90bcdf94dabd nodeName:}" failed. No retries permitted until 2026-07-17 14:52:27.747332877 +0000 UTC m=+160.945597219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-tls") pod "node-exporter-6wgkr" (UID: "5df2e55b-b7fe-48df-8eaa-90bcdf94dabd") : secret "node-exporter-tls" not found
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2b56\" (UniqueName: \"kubernetes.io/projected/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-kube-api-access-x2b56\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247426    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-wtmp\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-sys\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-root\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-textfile\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247862    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-textfile\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.247962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.247955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-sys\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.248390 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.248249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.248390 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.248301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-wtmp\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.248390 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.248339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-root\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.248567 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.248541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-accelerators-collector-config\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.249309 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.249258    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-metrics-client-ca\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.251012 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.250987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.251138 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.251031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.251138 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.251058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.261469 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.261446    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2b56\" (UniqueName: \"kubernetes.io/projected/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-kube-api-access-x2b56\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.261858 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.261832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftht\" (UniqueName: \"kubernetes.io/projected/6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c-kube-api-access-wftht\") pod \"kube-state-metrics-56c5594674-8nzwr\" (UID: \"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.288860 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.288829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:27.385978 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.385937    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:27.413977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.413949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"
Jul 17 14:52:27.487601 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.487568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:27.751333 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.751305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-tls\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:27.754335 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:27.754310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5df2e55b-b7fe-48df-8eaa-90bcdf94dabd-node-exporter-tls\") pod \"node-exporter-6wgkr\" (UID: \"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd\") " pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:28.023702 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.023624    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6wgkr"
Jul 17 14:52:28.026744 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.026707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:28.119131 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.119103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:28.124302 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.124275    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:52:28.129761 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.129738    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.132562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.132543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 14:52:28.132802 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.132781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 14:52:28.133066 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.133030    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 14:52:28.133380 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.133326    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 14:52:28.133495 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.133473    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 14:52:28.133617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.133601    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 14:52:28.133912 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.133876    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 14:52:28.134127 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.134112    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 14:52:28.134596 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.134577    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 14:52:28.134987 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.134969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fhrfs\""
Jul 17 14:52:28.154593 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-config-out\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154703 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154703 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154703 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154854 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154854 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154854 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-web-config\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154932    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dstjl\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-kube-api-access-dstjl\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.154977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.154966    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.155206 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.155070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.155206 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.155106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.155835 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.155809    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:52:28.256158 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256309 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256309 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256309 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256442 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:28.256378    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle podName:4304fa2b-5d19-412b-81dc-85be473819bc nodeName:}" failed. No retries permitted until 2026-07-17 14:52:28.756354064 +0000 UTC m=+161.954618398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc") : configmap references non-existent config key: ca-bundle.crt
Jul 17 14:52:28.256442 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256533 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256533 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-web-config\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256645 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dstjl\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-kube-api-access-dstjl\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256645 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256587    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256749 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256819 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256819 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256923 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-config-out\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.256923 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.257034 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.256998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.257034 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:28.257006    2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 17 14:52:28.257167 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:28.257087    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls podName:4304fa2b-5d19-412b-81dc-85be473819bc nodeName:}" failed. No retries permitted until 2026-07-17 14:52:28.757068593 +0000 UTC m=+161.955332913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc") : secret "alertmanager-main-tls" not found
Jul 17 14:52:28.259709 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.259681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.260175 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.260135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-web-config\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.260287 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.260181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.260287 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.260200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.260287 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.260263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.260510 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.260489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-config-out\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.260634 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.260614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.261014 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.260996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.267488 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.267469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dstjl\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-kube-api-access-dstjl\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.282080 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:28.282054    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df2e55b_b7fe_48df_8eaa_90bcdf94dabd.slice/crio-c33e4cfac09c96b4e9d6c899b6b519d94654970bee7b11ecae3a1a99a8162126 WatchSource:0}: Error finding container c33e4cfac09c96b4e9d6c899b6b519d94654970bee7b11ecae3a1a99a8162126: Status 404 returned error can't find the container with id c33e4cfac09c96b4e9d6c899b6b519d94654970bee7b11ecae3a1a99a8162126
Jul 17 14:52:28.421555 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.421532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8nzwr"]
Jul 17 14:52:28.423252 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:28.423230    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5bd6e4_fbc0_4d03_84e2_3ba879f5751c.slice/crio-671c65282103e84160364350c6a83eed78cd84ca709e09ceb9eed697d1a8486f WatchSource:0}: Error finding container 671c65282103e84160364350c6a83eed78cd84ca709e09ceb9eed697d1a8486f: Status 404 returned error can't find the container with id 671c65282103e84160364350c6a83eed78cd84ca709e09ceb9eed697d1a8486f
Jul 17 14:52:28.698992 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.698955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wgkr" event={"ID":"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd","Type":"ContainerStarted","Data":"c33e4cfac09c96b4e9d6c899b6b519d94654970bee7b11ecae3a1a99a8162126"}
Jul 17 14:52:28.700707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.700674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b846bb7-9lh5j" event={"ID":"c7eab092-985a-47eb-af89-e930d45a4993","Type":"ContainerStarted","Data":"5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619"}
Jul 17 14:52:28.702002 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.701978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr" event={"ID":"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c","Type":"ContainerStarted","Data":"671c65282103e84160364350c6a83eed78cd84ca709e09ceb9eed697d1a8486f"}
Jul 17 14:52:28.727312 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.727259    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-764b846bb7-9lh5j" podStartSLOduration=0.972865646 podStartE2EDuration="3.727242455s" totalImagesPullingTime="2.754376809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:28.725181752 +0000 UTC m=+161.923446092" watchObservedRunningTime="2026-07-17 14:52:28.727242455 +0000 UTC m=+161.925506793"
Jul 17 14:52:28.761754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.761724    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:52:28.761914 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.761871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.761985 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.761967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.762427 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:28.762406    2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 17 14:52:28.762529 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:28.762470    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls podName:4304fa2b-5d19-412b-81dc-85be473819bc nodeName:}" failed. No retries permitted until 2026-07-17 14:52:29.76245091 +0000 UTC m=+162.960715225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc") : secret "alertmanager-main-tls" not found
Jul 17 14:52:28.762980 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.762955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:28.764518 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.764498    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 14:52:28.775195 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.775175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd66ee5a-0971-4134-803c-8eab20c3c3d0-metrics-certs\") pod \"network-metrics-daemon-2qmwk\" (UID: \"cd66ee5a-0971-4134-803c-8eab20c3c3d0\") " pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:52:28.840408 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.840375    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7594c\""
Jul 17 14:52:28.848612 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.848590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qmwk"
Jul 17 14:52:28.875320 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.875281    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:29.000686 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:28.999523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2qmwk"]
Jul 17 14:52:29.133779 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:29.133752    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd66ee5a_0971_4134_803c_8eab20c3c3d0.slice/crio-95e39838b73e587eca774ebcb6d370d13dfbacfa951aabe050ff09c7a8b6383e WatchSource:0}: Error finding container 95e39838b73e587eca774ebcb6d370d13dfbacfa951aabe050ff09c7a8b6383e: Status 404 returned error can't find the container with id 95e39838b73e587eca774ebcb6d370d13dfbacfa951aabe050ff09c7a8b6383e
Jul 17 14:52:29.707017 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:29.706979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qmwk" event={"ID":"cd66ee5a-0971-4134-803c-8eab20c3c3d0","Type":"ContainerStarted","Data":"95e39838b73e587eca774ebcb6d370d13dfbacfa951aabe050ff09c7a8b6383e"}
Jul 17 14:52:29.708998 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:29.708967    2561 generic.go:356] "Generic (PLEG): container finished" podID="5df2e55b-b7fe-48df-8eaa-90bcdf94dabd" containerID="8f58f92d614f52fc4663db1f8622a43b0fee1ea608ae1be43307f970ddfa1180" exitCode=0
Jul 17 14:52:29.709129 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:29.709072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wgkr" event={"ID":"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd","Type":"ContainerDied","Data":"8f58f92d614f52fc4663db1f8622a43b0fee1ea608ae1be43307f970ddfa1180"}
Jul 17 14:52:29.771609 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:29.771586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:29.775180 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:29.775157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:29.942498 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:29.942461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:52:30.005475 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.005398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.066359 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.066310    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.199636 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.199577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.301234 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.301141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.548735 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.548644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.551371 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.550725    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:52:30.555861 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:30.555817    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4304fa2b_5d19_412b_81dc_85be473819bc.slice/crio-ab1feb53d0a5149febc9d5634ed78f0b61692452af049903d83f22ba7439a632 WatchSource:0}: Error finding container ab1feb53d0a5149febc9d5634ed78f0b61692452af049903d83f22ba7439a632: Status 404 returned error can't find the container with id ab1feb53d0a5149febc9d5634ed78f0b61692452af049903d83f22ba7439a632
Jul 17 14:52:30.641531 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.641502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.715249 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.715211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wgkr" event={"ID":"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd","Type":"ContainerStarted","Data":"65bf634ae89f57e9d938bcbb03c6b5d046325cc0538772d9716397217dbff7f3"}
Jul 17 14:52:30.715441 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.715273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6wgkr" event={"ID":"5df2e55b-b7fe-48df-8eaa-90bcdf94dabd","Type":"ContainerStarted","Data":"42503535649f161ce40664c494b17854e867cc28b2a7ad23a2c2caa6d129e97a"}
Jul 17 14:52:30.717495 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.717465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr" event={"ID":"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c","Type":"ContainerStarted","Data":"373a0b347c8a06cb787150374190c8bbd4d1d27ec0f4418b763fba6eba11121d"}
Jul 17 14:52:30.717660 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.717528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr" event={"ID":"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c","Type":"ContainerStarted","Data":"15480e4a21a864dae15a06b18b18c51e45daaa807e1a41cebde20d0ab96014b9"}
Jul 17 14:52:30.717660 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.717555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr" event={"ID":"6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c","Type":"ContainerStarted","Data":"4957c31bb505b3fbafaa7a0d8d06870484755fc8fa3987353cc0d8e667c4dcb6"}
Jul 17 14:52:30.719191 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.719163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qmwk" event={"ID":"cd66ee5a-0971-4134-803c-8eab20c3c3d0","Type":"ContainerStarted","Data":"15824bb4301cee301ca7d5b9e6f500dcc4cda1124e142a993aa1874179af3977"}
Jul 17 14:52:30.719323 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.719213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qmwk" event={"ID":"cd66ee5a-0971-4134-803c-8eab20c3c3d0","Type":"ContainerStarted","Data":"c6e20978a097d24a8a17f8ff21dc7a7dde4a3c3a25637e41d96b7b3ec00b3844"}
Jul 17 14:52:30.720422 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.720403    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerStarted","Data":"ab1feb53d0a5149febc9d5634ed78f0b61692452af049903d83f22ba7439a632"}
Jul 17 14:52:30.737314 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.736259    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6wgkr" podStartSLOduration=2.764736282 podStartE2EDuration="3.736243694s" totalImagesPullingTime="893.117891ms" totalInitContainerRuntime="78.389521ms" isStatefulPod=true podCreationTimestamp="2026-07-17 14:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:30.735354469 +0000 UTC m=+163.933618833" watchObservedRunningTime="2026-07-17 14:52:30.736243694 +0000 UTC m=+163.934508033"
Jul 17 14:52:30.751845 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.751818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.755691 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.755651    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-8nzwr" podStartSLOduration=1.788344924 podStartE2EDuration="3.755637745s" totalImagesPullingTime="1.967292821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:30.753829253 +0000 UTC m=+163.952093590" watchObservedRunningTime="2026-07-17 14:52:30.755637745 +0000 UTC m=+163.953902083"
Jul 17 14:52:30.775245 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.775207    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2qmwk" podStartSLOduration=129.516843697 podStartE2EDuration="2m10.775193566s" totalImagesPullingTime="1.258349869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:30.774982623 +0000 UTC m=+163.973246962" watchObservedRunningTime="2026-07-17 14:52:30.775193566 +0000 UTC m=+163.973457933"
Jul 17 14:52:30.821610 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.821519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:30.922576 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:30.922540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:31.021968 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.021940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:31.341999 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.341957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:31.395014 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.394958    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"]
Jul 17 14:52:31.398109 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.398088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.400611 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.400592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 14:52:31.401759 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.401647    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rzw7z\""
Jul 17 14:52:31.401759 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.401676    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1nb6sdjlr52np\""
Jul 17 14:52:31.401759 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.401692    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 17 14:52:31.401955 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.401797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 17 14:52:31.401955 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.401818    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 17 14:52:31.411890 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.411870    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"]
Jul 17 14:52:31.442181 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.442147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:31.484986 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.484958    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-secret-metrics-server-client-certs\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.485158 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.485007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-audit-log\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.485158 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.485029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-metrics-server-audit-profiles\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.485158 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.485140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkq5b\" (UniqueName: \"kubernetes.io/projected/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-kube-api-access-hkq5b\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.485319 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.485227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-secret-metrics-server-tls\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.485319 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.485270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-client-ca-bundle\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.485319 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.485289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586033 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-client-ca-bundle\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586207 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586207 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-secret-metrics-server-client-certs\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586207 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-audit-log\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586368 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-metrics-server-audit-profiles\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586368 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkq5b\" (UniqueName: \"kubernetes.io/projected/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-kube-api-access-hkq5b\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586471 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-secret-metrics-server-tls\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-audit-log\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.586961 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.586915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.587615 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.587579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-metrics-server-audit-profiles\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.588977 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.588953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-secret-metrics-server-client-certs\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.589110 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.589087    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-client-ca-bundle\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.589193 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.589169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-secret-metrics-server-tls\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.601052 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.600992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkq5b\" (UniqueName: \"kubernetes.io/projected/1a15197e-f4e4-4893-ab27-8d2c8dd2d366-kube-api-access-hkq5b\") pod \"metrics-server-7ddcd7db6b-q5vj5\" (UID: \"1a15197e-f4e4-4893-ab27-8d2c8dd2d366\") " pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.712016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.711986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:31.789787 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.789748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:31.864366 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.864301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:31.878778 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:31.878755    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"]
Jul 17 14:52:31.894848 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:31.894826    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a15197e_f4e4_4893_ab27_8d2c8dd2d366.slice/crio-4bfb974e7614225dc6d5efc0053e5f7f66f954c0f0d77fc6a34a93012f434e82 WatchSource:0}: Error finding container 4bfb974e7614225dc6d5efc0053e5f7f66f954c0f0d77fc6a34a93012f434e82: Status 404 returned error can't find the container with id 4bfb974e7614225dc6d5efc0053e5f7f66f954c0f0d77fc6a34a93012f434e82
Jul 17 14:52:32.093884 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:32.093853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:32.730288 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:32.730257    2561 generic.go:356] "Generic (PLEG): container finished" podID="4304fa2b-5d19-412b-81dc-85be473819bc" containerID="c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34" exitCode=0
Jul 17 14:52:32.730705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:32.730350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34"}
Jul 17 14:52:32.731660 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:32.731636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5" event={"ID":"1a15197e-f4e4-4893-ab27-8d2c8dd2d366","Type":"ContainerStarted","Data":"4bfb974e7614225dc6d5efc0053e5f7f66f954c0f0d77fc6a34a93012f434e82"}
Jul 17 14:52:33.370457 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.370405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:33.639700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.639604    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:52:33.753761 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.753055    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764b846bb7-9lh5j"]
Jul 17 14:52:33.792978 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.792939    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-576c94667c-7krdd"]
Jul 17 14:52:33.796896 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.796852    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:33.809278 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.809253    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576c94667c-7krdd"]
Jul 17 14:52:33.833805 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.833707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:33.899864 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.899775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:33.906729 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.906702    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-oauth-config\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:33.906885 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.906759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-serving-cert\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:33.906885 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.906790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-oauth-serving-cert\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:33.906885 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.906819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-service-ca\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:33.906885 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.906843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmpz7\" (UniqueName: \"kubernetes.io/projected/f47776d8-6b74-4817-b122-10d35c03d9f2-kube-api-access-hmpz7\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:33.906885 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.906880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-console-config\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:33.907123 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:33.906926    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-trusted-ca-bundle\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.007413 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.007347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-oauth-serving-cert\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.007413 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.007395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-service-ca\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.007614 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.007420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmpz7\" (UniqueName: \"kubernetes.io/projected/f47776d8-6b74-4817-b122-10d35c03d9f2-kube-api-access-hmpz7\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.007614 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.007464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-console-config\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.007614 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.007489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-trusted-ca-bundle\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.007614 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.007542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-oauth-config\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.007614 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.007596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-serving-cert\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.008207 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.008159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-oauth-serving-cert\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.008207 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.008195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-console-config\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.008365 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.008223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-service-ca\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.008472 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.008450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-trusted-ca-bundle\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.010535 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.010513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-serving-cert\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.010643 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.010603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-oauth-config\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.018637 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.018294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmpz7\" (UniqueName: \"kubernetes.io/projected/f47776d8-6b74-4817-b122-10d35c03d9f2-kube-api-access-hmpz7\") pod \"console-576c94667c-7krdd\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") " pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.111627 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.111585    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:34.263336 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.263293    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576c94667c-7krdd"]
Jul 17 14:52:34.539389 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:52:34.539327    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47776d8_6b74_4817_b122_10d35c03d9f2.slice/crio-23efb14cc33e3168d31760b227f2b53dc0bdca5cfe0abad8bb47488ec0631c85 WatchSource:0}: Error finding container 23efb14cc33e3168d31760b227f2b53dc0bdca5cfe0abad8bb47488ec0631c85: Status 404 returned error can't find the container with id 23efb14cc33e3168d31760b227f2b53dc0bdca5cfe0abad8bb47488ec0631c85
Jul 17 14:52:34.744528 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.744500    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5" event={"ID":"1a15197e-f4e4-4893-ab27-8d2c8dd2d366","Type":"ContainerStarted","Data":"744bc713a8e90d67319cd96dee334f2f274dccf398847598ab2fc5d05f495723"}
Jul 17 14:52:34.746815 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.746789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerStarted","Data":"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"}
Jul 17 14:52:34.746924 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.746861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerStarted","Data":"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"}
Jul 17 14:52:34.748453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.748421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576c94667c-7krdd" event={"ID":"f47776d8-6b74-4817-b122-10d35c03d9f2","Type":"ContainerStarted","Data":"99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852"}
Jul 17 14:52:34.748453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.748464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576c94667c-7krdd" event={"ID":"f47776d8-6b74-4817-b122-10d35c03d9f2","Type":"ContainerStarted","Data":"23efb14cc33e3168d31760b227f2b53dc0bdca5cfe0abad8bb47488ec0631c85"}
Jul 17 14:52:34.767737 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.767520    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5" podStartSLOduration=1.731088509 podStartE2EDuration="3.767505556s" totalImagesPullingTime="2.036417047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:34.765978852 +0000 UTC m=+167.964243215" watchObservedRunningTime="2026-07-17 14:52:34.767505556 +0000 UTC m=+167.965769958"
Jul 17 14:52:34.790024 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:34.789925    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-576c94667c-7krdd" podStartSLOduration=1.789906129 podStartE2EDuration="1.789906129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:34.788800454 +0000 UTC m=+167.987064793" watchObservedRunningTime="2026-07-17 14:52:34.789906129 +0000 UTC m=+167.988170468"
Jul 17 14:52:35.341157 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.341121    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:35.403655 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.403630    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:35.452695 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.452674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:35.756499 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.756462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerStarted","Data":"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"}
Jul 17 14:52:35.756672 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.756539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerStarted","Data":"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"}
Jul 17 14:52:35.756672 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.756584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerStarted","Data":"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"}
Jul 17 14:52:35.936956 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.936920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:35.996916 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:35.996891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:36.765422 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:36.765392    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerStarted","Data":"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"}
Jul 17 14:52:36.772554 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:36.772535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:36.805230 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:36.805187    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.841988301 podStartE2EDuration="8.805172821s" totalImagesPullingTime="3.94179942s" totalInitContainerRuntime="21.3851ms" isStatefulPod=false podCreationTimestamp="2026-07-17 14:52:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:52:36.803493667 +0000 UTC m=+170.001758005" watchObservedRunningTime="2026-07-17 14:52:36.805172821 +0000 UTC m=+170.003437180"
Jul 17 14:52:36.878178 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:36.878153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:37.465203 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:37.465169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:37.567299 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:37.567264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:39.728906 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:39.728829    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68bddc45fc-prgfj"]
Jul 17 14:52:39.822419 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:39.822375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:39.972933 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:39.972899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:40.085604 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:40.085503    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:40.191623 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:40.191583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:40.293136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:40.293107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:43.142632 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:43.142605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:43.245793 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:43.245763    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:44.112179 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:44.112142    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:44.112337 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:44.112245    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:44.117013 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:44.116991    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:44.797508 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:44.797476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:52:45.060814 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:45.060721    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:45.160238 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:45.160197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:46.596497 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:46.596452    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:46.678293 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:46.678264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:47.350381 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:47.350349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:47.452017 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:47.451989    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:47.955426 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:47.955394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:48.056259 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:48.056231    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:51.712720 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:51.712692    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:51.713085 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:51.712749    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:52:54.975812 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:54.975772    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:55.040237 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:55.040213    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:52:58.784844 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:58.784806    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-764b846bb7-9lh5j" podUID="c7eab092-985a-47eb-af89-e930d45a4993" containerName="console" containerID="cri-o://5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619" gracePeriod=15
Jul 17 14:52:59.024165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.024145    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:59.104656 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104586    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwh68\" (UniqueName: \"kubernetes.io/projected/c7eab092-985a-47eb-af89-e930d45a4993-kube-api-access-mwh68\") pod \"c7eab092-985a-47eb-af89-e930d45a4993\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") "
Jul 17 14:52:59.104656 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104616    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-service-ca\") pod \"c7eab092-985a-47eb-af89-e930d45a4993\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") "
Jul 17 14:52:59.104656 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104645    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-console-config\") pod \"c7eab092-985a-47eb-af89-e930d45a4993\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") "
Jul 17 14:52:59.104901 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104667    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-oauth-serving-cert\") pod \"c7eab092-985a-47eb-af89-e930d45a4993\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") "
Jul 17 14:52:59.104901 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104711    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-oauth-config\") pod \"c7eab092-985a-47eb-af89-e930d45a4993\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") "
Jul 17 14:52:59.104901 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-serving-cert\") pod \"c7eab092-985a-47eb-af89-e930d45a4993\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") "
Jul 17 14:52:59.104901 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104812    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-trusted-ca-bundle\") pod \"c7eab092-985a-47eb-af89-e930d45a4993\" (UID: \"c7eab092-985a-47eb-af89-e930d45a4993\") "
Jul 17 14:52:59.105138 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.104986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7eab092-985a-47eb-af89-e930d45a4993" (UID: "c7eab092-985a-47eb-af89-e930d45a4993"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:52:59.105138 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.105073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-console-config" (OuterVolumeSpecName: "console-config") pod "c7eab092-985a-47eb-af89-e930d45a4993" (UID: "c7eab092-985a-47eb-af89-e930d45a4993"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:52:59.105238 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.105137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7eab092-985a-47eb-af89-e930d45a4993" (UID: "c7eab092-985a-47eb-af89-e930d45a4993"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:52:59.105351 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.105331    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7eab092-985a-47eb-af89-e930d45a4993" (UID: "c7eab092-985a-47eb-af89-e930d45a4993"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:52:59.107095 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.107059    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7eab092-985a-47eb-af89-e930d45a4993" (UID: "c7eab092-985a-47eb-af89-e930d45a4993"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:52:59.107192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.107101    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7eab092-985a-47eb-af89-e930d45a4993" (UID: "c7eab092-985a-47eb-af89-e930d45a4993"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:52:59.107192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.107112    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7eab092-985a-47eb-af89-e930d45a4993-kube-api-access-mwh68" (OuterVolumeSpecName: "kube-api-access-mwh68") pod "c7eab092-985a-47eb-af89-e930d45a4993" (UID: "c7eab092-985a-47eb-af89-e930d45a4993"). InnerVolumeSpecName "kube-api-access-mwh68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:52:59.205579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.205546    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-console-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:52:59.205579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.205576    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-oauth-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:52:59.205579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.205586    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-oauth-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:52:59.205730 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.205595    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7eab092-985a-47eb-af89-e930d45a4993-console-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:52:59.205730 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.205605    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-trusted-ca-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:52:59.205730 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.205612    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwh68\" (UniqueName: \"kubernetes.io/projected/c7eab092-985a-47eb-af89-e930d45a4993-kube-api-access-mwh68\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:52:59.205730 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.205621    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7eab092-985a-47eb-af89-e930d45a4993-service-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:52:59.846690 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.846656    2561 generic.go:356] "Generic (PLEG): container finished" podID="c7eab092-985a-47eb-af89-e930d45a4993" containerID="5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619" exitCode=0
Jul 17 14:52:59.847087 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.846703    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-764b846bb7-9lh5j"
Jul 17 14:52:59.847087 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.846718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b846bb7-9lh5j" event={"ID":"c7eab092-985a-47eb-af89-e930d45a4993","Type":"ContainerDied","Data":"5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619"}
Jul 17 14:52:59.847087 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.846767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-764b846bb7-9lh5j" event={"ID":"c7eab092-985a-47eb-af89-e930d45a4993","Type":"ContainerDied","Data":"a9603a3f8f01ce9d5cfc514131c847d86cd1d4a75e87f7ebe3aac4348f5dc188"}
Jul 17 14:52:59.847087 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.846793    2561 scope.go:117] "RemoveContainer" containerID="5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619"
Jul 17 14:52:59.854819 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.854798    2561 scope.go:117] "RemoveContainer" containerID="5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619"
Jul 17 14:52:59.855094 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:52:59.855073    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619\": container with ID starting with 5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619 not found: ID does not exist" containerID="5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619"
Jul 17 14:52:59.855169 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.855109    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619"} err="failed to get container status \"5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619\": rpc error: code = NotFound desc = could not find container \"5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619\": container with ID starting with 5667ff9fa0b6986d9f91bc4f8bc182453aa0a7502b00f22542fe52a6c3e3d619 not found: ID does not exist"
Jul 17 14:52:59.868115 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.868088    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-764b846bb7-9lh5j"]
Jul 17 14:52:59.870734 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:52:59.870713    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-764b846bb7-9lh5j"]
Jul 17 14:53:01.231094 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:01.231030    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7eab092-985a-47eb-af89-e930d45a4993" path="/var/lib/kubelet/pods/c7eab092-985a-47eb-af89-e930d45a4993/volumes"
Jul 17 14:53:01.397389 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:01.397335    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vd75z_2df39284-4e0b-4963-8975-e5343be7e400/serve-healthcheck-canary/0.log"
Jul 17 14:53:04.749558 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:04.749504    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj" podUID="fffb8d1d-842b-491d-b9a2-bc739341fe1d" containerName="registry" containerID="cri-o://acc4c5112af3be3a3e1a1781f8206e33bdbd13fa9fc362c9362f6f1db9f2a6a9" gracePeriod=30
Jul 17 14:53:04.866091 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:04.866066    2561 generic.go:356] "Generic (PLEG): container finished" podID="fffb8d1d-842b-491d-b9a2-bc739341fe1d" containerID="acc4c5112af3be3a3e1a1781f8206e33bdbd13fa9fc362c9362f6f1db9f2a6a9" exitCode=0
Jul 17 14:53:04.866091 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:04.866075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj" event={"ID":"fffb8d1d-842b-491d-b9a2-bc739341fe1d","Type":"ContainerDied","Data":"acc4c5112af3be3a3e1a1781f8206e33bdbd13fa9fc362c9362f6f1db9f2a6a9"}
Jul 17 14:53:04.990455 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:04.990433    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:53:05.145000 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.144967    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-certificates\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145170 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145014    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-installation-pull-secrets\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145170 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145089    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-image-registry-private-configuration\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145170 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145122    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fffb8d1d-842b-491d-b9a2-bc739341fe1d-ca-trust-extracted\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145170 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdb6v\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-kube-api-access-wdb6v\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145377 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145183    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-trusted-ca\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145377 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145216    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145377 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145244    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-bound-sa-token\") pod \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\" (UID: \"fffb8d1d-842b-491d-b9a2-bc739341fe1d\") "
Jul 17 14:53:05.145579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:53:05.145719 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.145667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:53:05.147563 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.147527    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:05.147680 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.147658    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:05.147965 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.147940    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-kube-api-access-wdb6v" (OuterVolumeSpecName: "kube-api-access-wdb6v") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "kube-api-access-wdb6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:53:05.148090 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.148066    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:53:05.148171 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.148152    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:53:05.153927 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.153905    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffb8d1d-842b-491d-b9a2-bc739341fe1d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fffb8d1d-842b-491d-b9a2-bc739341fe1d" (UID: "fffb8d1d-842b-491d-b9a2-bc739341fe1d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:53:05.245755 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245733    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-image-registry-private-configuration\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.245755 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245756    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fffb8d1d-842b-491d-b9a2-bc739341fe1d-ca-trust-extracted\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.245889 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245765    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdb6v\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-kube-api-access-wdb6v\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.245889 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245792    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-trusted-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.245889 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245801    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-tls\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.245889 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245809    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fffb8d1d-842b-491d-b9a2-bc739341fe1d-bound-sa-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.245889 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245816    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fffb8d1d-842b-491d-b9a2-bc739341fe1d-registry-certificates\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.245889 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.245825    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fffb8d1d-842b-491d-b9a2-bc739341fe1d-installation-pull-secrets\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:05.870930 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.870906    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj"
Jul 17 14:53:05.870930 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.870914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68bddc45fc-prgfj" event={"ID":"fffb8d1d-842b-491d-b9a2-bc739341fe1d","Type":"ContainerDied","Data":"884cc581968dbfbc99ad167fdcb0dec0a87a585feb0ba09cb7a0978423c17c9d"}
Jul 17 14:53:05.871384 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.870974    2561 scope.go:117] "RemoveContainer" containerID="acc4c5112af3be3a3e1a1781f8206e33bdbd13fa9fc362c9362f6f1db9f2a6a9"
Jul 17 14:53:05.892353 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.892330    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68bddc45fc-prgfj"]
Jul 17 14:53:05.900020 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:05.899999    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68bddc45fc-prgfj"]
Jul 17 14:53:07.230875 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:07.230842    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fffb8d1d-842b-491d-b9a2-bc739341fe1d" path="/var/lib/kubelet/pods/fffb8d1d-842b-491d-b9a2-bc739341fe1d/volumes"
Jul 17 14:53:11.717963 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:11.717934    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:53:11.722549 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:11.722526    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7ddcd7db6b-q5vj5"
Jul 17 14:53:15.041271 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:15.041243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:53:15.207810 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:15.207782    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:53:15.407731 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:15.407702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:53:46.453608 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:46.453568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:53:46.870785 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:46.870670    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:53:47.497029 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:47.496988    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:53:47.497444 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:47.497280    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="alertmanager" containerID="cri-o://67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef" gracePeriod=120
Jul 17 14:53:47.497444 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:47.497342    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-metric" containerID="cri-o://8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64" gracePeriod=120
Jul 17 14:53:47.497444 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:47.497401    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy" containerID="cri-o://985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e" gracePeriod=120
Jul 17 14:53:47.497444 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:47.497394    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="prom-label-proxy" containerID="cri-o://0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414" gracePeriod=120
Jul 17 14:53:47.497444 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:47.497401    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-web" containerID="cri-o://f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f" gracePeriod=120
Jul 17 14:53:47.497689 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:47.497431    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="config-reloader" containerID="cri-o://7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810" gracePeriod=120
Jul 17 14:53:48.030459 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030427    2561 generic.go:356] "Generic (PLEG): container finished" podID="4304fa2b-5d19-412b-81dc-85be473819bc" containerID="0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414" exitCode=0
Jul 17 14:53:48.030459 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030452    2561 generic.go:356] "Generic (PLEG): container finished" podID="4304fa2b-5d19-412b-81dc-85be473819bc" containerID="985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e" exitCode=0
Jul 17 14:53:48.030459 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030460    2561 generic.go:356] "Generic (PLEG): container finished" podID="4304fa2b-5d19-412b-81dc-85be473819bc" containerID="7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810" exitCode=0
Jul 17 14:53:48.030459 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030466    2561 generic.go:356] "Generic (PLEG): container finished" podID="4304fa2b-5d19-412b-81dc-85be473819bc" containerID="67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef" exitCode=0
Jul 17 14:53:48.030777 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"}
Jul 17 14:53:48.030777 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"}
Jul 17 14:53:48.030777 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030628    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"}
Jul 17 14:53:48.030777 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.030662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"}
Jul 17 14:53:48.749332 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.749313    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:48.751227 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751209    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751278 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751249    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dstjl\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-kube-api-access-dstjl\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751278 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-main-db\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751344 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751290    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751402    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-config-out\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751458 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751437    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-web-config\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751510 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751460    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-config-volume\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751510    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-metrics-client-ca\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751538    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:53:48.751571 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751569    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-tls-assets\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751764 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751605    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751764 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751643    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-cluster-tls-config\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.751764 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls\") pod \"4304fa2b-5d19-412b-81dc-85be473819bc\" (UID: \"4304fa2b-5d19-412b-81dc-85be473819bc\") "
Jul 17 14:53:48.752238 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.751941    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:53:48.752238 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.752063    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-main-db\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.753894 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.753861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-kube-api-access-dstjl" (OuterVolumeSpecName: "kube-api-access-dstjl") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "kube-api-access-dstjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:53:48.754002 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.752085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:53:48.756249 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.755217    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-config-volume" (OuterVolumeSpecName: "config-volume") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:48.756249 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.755265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:48.756249 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.756194    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-config-out" (OuterVolumeSpecName: "config-out") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:53:48.762559 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.762332    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:48.762758 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.762719    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:48.764144 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.764116    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:48.764375 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.764353    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:53:48.765114 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.765093    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:48.771066 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.771025    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-web-config" (OuterVolumeSpecName: "web-config") pod "4304fa2b-5d19-412b-81dc-85be473819bc" (UID: "4304fa2b-5d19-412b-81dc-85be473819bc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852365    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dstjl\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-kube-api-access-dstjl\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852390    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852401    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4304fa2b-5d19-412b-81dc-85be473819bc-config-out\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852409    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-web-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852417    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-config-volume\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852425    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-metrics-client-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852434    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852443    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4304fa2b-5d19-412b-81dc-85be473819bc-tls-assets\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852443 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852451    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852995 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852459    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-cluster-tls-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852995 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852467    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4304fa2b-5d19-412b-81dc-85be473819bc-secret-alertmanager-main-tls\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:48.852995 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:48.852475    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4304fa2b-5d19-412b-81dc-85be473819bc-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:53:49.037079 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.037022    2561 generic.go:356] "Generic (PLEG): container finished" podID="4304fa2b-5d19-412b-81dc-85be473819bc" containerID="8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64" exitCode=0
Jul 17 14:53:49.037079 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.037072    2561 generic.go:356] "Generic (PLEG): container finished" podID="4304fa2b-5d19-412b-81dc-85be473819bc" containerID="f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f" exitCode=0
Jul 17 14:53:49.037267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.037104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"}
Jul 17 14:53:49.037267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.037139    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.037267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.037199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"}
Jul 17 14:53:49.037267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.037227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4304fa2b-5d19-412b-81dc-85be473819bc","Type":"ContainerDied","Data":"ab1feb53d0a5149febc9d5634ed78f0b61692452af049903d83f22ba7439a632"}
Jul 17 14:53:49.037267 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.037258    2561 scope.go:117] "RemoveContainer" containerID="0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"
Jul 17 14:53:49.045155 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.045135    2561 scope.go:117] "RemoveContainer" containerID="8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"
Jul 17 14:53:49.052319 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.052303    2561 scope.go:117] "RemoveContainer" containerID="985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"
Jul 17 14:53:49.058522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.058507    2561 scope.go:117] "RemoveContainer" containerID="f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"
Jul 17 14:53:49.064764 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.064743    2561 scope.go:117] "RemoveContainer" containerID="7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"
Jul 17 14:53:49.067333 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.067315    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:53:49.071987 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.071971    2561 scope.go:117] "RemoveContainer" containerID="67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"
Jul 17 14:53:49.078617 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.078603    2561 scope.go:117] "RemoveContainer" containerID="c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34"
Jul 17 14:53:49.084581 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.084561    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:53:49.085890 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.085878    2561 scope.go:117] "RemoveContainer" containerID="0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"
Jul 17 14:53:49.086163 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:53:49.086146    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414\": container with ID starting with 0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414 not found: ID does not exist" containerID="0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"
Jul 17 14:53:49.086217 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086171    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"} err="failed to get container status \"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414\": rpc error: code = NotFound desc = could not find container \"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414\": container with ID starting with 0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414 not found: ID does not exist"
Jul 17 14:53:49.086217 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086190    2561 scope.go:117] "RemoveContainer" containerID="8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"
Jul 17 14:53:49.086440 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:53:49.086423    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64\": container with ID starting with 8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64 not found: ID does not exist" containerID="8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"
Jul 17 14:53:49.086505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086449    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"} err="failed to get container status \"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64\": rpc error: code = NotFound desc = could not find container \"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64\": container with ID starting with 8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64 not found: ID does not exist"
Jul 17 14:53:49.086505 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086470    2561 scope.go:117] "RemoveContainer" containerID="985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"
Jul 17 14:53:49.086681 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:53:49.086666    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e\": container with ID starting with 985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e not found: ID does not exist" containerID="985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"
Jul 17 14:53:49.086718 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086685    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"} err="failed to get container status \"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e\": rpc error: code = NotFound desc = could not find container \"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e\": container with ID starting with 985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e not found: ID does not exist"
Jul 17 14:53:49.086718 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086698    2561 scope.go:117] "RemoveContainer" containerID="f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"
Jul 17 14:53:49.086900 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:53:49.086885    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f\": container with ID starting with f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f not found: ID does not exist" containerID="f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"
Jul 17 14:53:49.086941 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086904    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"} err="failed to get container status \"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f\": rpc error: code = NotFound desc = could not find container \"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f\": container with ID starting with f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f not found: ID does not exist"
Jul 17 14:53:49.086941 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.086916    2561 scope.go:117] "RemoveContainer" containerID="7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"
Jul 17 14:53:49.087115 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:53:49.087099    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810\": container with ID starting with 7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810 not found: ID does not exist" containerID="7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"
Jul 17 14:53:49.087170 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087118    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"} err="failed to get container status \"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810\": rpc error: code = NotFound desc = could not find container \"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810\": container with ID starting with 7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810 not found: ID does not exist"
Jul 17 14:53:49.087170 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087129    2561 scope.go:117] "RemoveContainer" containerID="67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"
Jul 17 14:53:49.087322 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:53:49.087305    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef\": container with ID starting with 67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef not found: ID does not exist" containerID="67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"
Jul 17 14:53:49.087361 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087326    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"} err="failed to get container status \"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef\": rpc error: code = NotFound desc = could not find container \"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef\": container with ID starting with 67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef not found: ID does not exist"
Jul 17 14:53:49.087361 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087340    2561 scope.go:117] "RemoveContainer" containerID="c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34"
Jul 17 14:53:49.087547 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:53:49.087531    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34\": container with ID starting with c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34 not found: ID does not exist" containerID="c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34"
Jul 17 14:53:49.087605 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087554    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34"} err="failed to get container status \"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34\": rpc error: code = NotFound desc = could not find container \"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34\": container with ID starting with c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34 not found: ID does not exist"
Jul 17 14:53:49.087605 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087573    2561 scope.go:117] "RemoveContainer" containerID="0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"
Jul 17 14:53:49.087784 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087770    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414"} err="failed to get container status \"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414\": rpc error: code = NotFound desc = could not find container \"0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414\": container with ID starting with 0d5ee2327410d0211b800fad2d97315156117525c9ac170a712e6b123b0e3414 not found: ID does not exist"
Jul 17 14:53:49.087829 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087784    2561 scope.go:117] "RemoveContainer" containerID="8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"
Jul 17 14:53:49.087996 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087980    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64"} err="failed to get container status \"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64\": rpc error: code = NotFound desc = could not find container \"8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64\": container with ID starting with 8609ff5adb5434d8a53d1d23729a27e3bc3dbf37ec2d4f28881447f754affd64 not found: ID does not exist"
Jul 17 14:53:49.088058 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.087995    2561 scope.go:117] "RemoveContainer" containerID="985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"
Jul 17 14:53:49.088187 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088171    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e"} err="failed to get container status \"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e\": rpc error: code = NotFound desc = could not find container \"985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e\": container with ID starting with 985f0a92f89fbd529407ff87b4ffaf17fa1cadf558799b4fa1e9d4d5c3b8e34e not found: ID does not exist"
Jul 17 14:53:49.088238 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088189    2561 scope.go:117] "RemoveContainer" containerID="f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"
Jul 17 14:53:49.088386 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088366    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f"} err="failed to get container status \"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f\": rpc error: code = NotFound desc = could not find container \"f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f\": container with ID starting with f657cb4ebfe7d1eb9457c1668add532861b32f3fbf93887f7f52fdb0c809011f not found: ID does not exist"
Jul 17 14:53:49.088425 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088388    2561 scope.go:117] "RemoveContainer" containerID="7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"
Jul 17 14:53:49.088582 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088565    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810"} err="failed to get container status \"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810\": rpc error: code = NotFound desc = could not find container \"7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810\": container with ID starting with 7888dfdc6e2977f5cc46c283526bbd487d528f17cc5f511fe12e04f14b1e0810 not found: ID does not exist"
Jul 17 14:53:49.088649 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088587    2561 scope.go:117] "RemoveContainer" containerID="67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"
Jul 17 14:53:49.088789 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088773    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef"} err="failed to get container status \"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef\": rpc error: code = NotFound desc = could not find container \"67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef\": container with ID starting with 67e62b08d8adef6bec49c3e5488836635f06dc9730b464aed47fa332c6fe44ef not found: ID does not exist"
Jul 17 14:53:49.088851 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088790    2561 scope.go:117] "RemoveContainer" containerID="c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34"
Jul 17 14:53:49.089023 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.088996    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34"} err="failed to get container status \"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34\": rpc error: code = NotFound desc = could not find container \"c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34\": container with ID starting with c706c60c92c19b1d5f2765f943087dd6ee7d2acb756041722c800c8403345a34 not found: ID does not exist"
Jul 17 14:53:49.125477 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125402    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:53:49.125659 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125647    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-metric"
Jul 17 14:53:49.125705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125660    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-metric"
Jul 17 14:53:49.125705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125670    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffb8d1d-842b-491d-b9a2-bc739341fe1d" containerName="registry"
Jul 17 14:53:49.125705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125676    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffb8d1d-842b-491d-b9a2-bc739341fe1d" containerName="registry"
Jul 17 14:53:49.125705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125686    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="config-reloader"
Jul 17 14:53:49.125705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125693    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="config-reloader"
Jul 17 14:53:49.125705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125700    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="alertmanager"
Jul 17 14:53:49.125705 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125705    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="alertmanager"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125712    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-web"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125717    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-web"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125724    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="prom-label-proxy"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125731    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="prom-label-proxy"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125737    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7eab092-985a-47eb-af89-e930d45a4993" containerName="console"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125743    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7eab092-985a-47eb-af89-e930d45a4993" containerName="console"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125751    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125756    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125761    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="init-config-reloader"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125766    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="init-config-reloader"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125802    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7eab092-985a-47eb-af89-e930d45a4993" containerName="console"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125808    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-web"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125815    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="prom-label-proxy"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125820    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fffb8d1d-842b-491d-b9a2-bc739341fe1d" containerName="registry"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125825    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="config-reloader"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125830    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125834    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="alertmanager"
Jul 17 14:53:49.125905 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.125839    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" containerName="kube-rbac-proxy-metric"
Jul 17 14:53:49.130762 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.130747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.133479 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.133458    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 14:53:49.133564 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.133537    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 14:53:49.133924 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.133905    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fhrfs\""
Jul 17 14:53:49.133994 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.133952    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 14:53:49.134071 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.134003    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 14:53:49.134150 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.134129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 14:53:49.134229 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.134179    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 14:53:49.134312 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.134296    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 14:53:49.134509 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.134495    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 14:53:49.140587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.140570    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 14:53:49.147652 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.147626    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:53:49.154004 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.153980    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154102 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2184647-a2d4-493d-b7a9-582ee94b0ec9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154102 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154102 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-web-config\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2184647-a2d4-493d-b7a9-582ee94b0ec9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2184647-a2d4-493d-b7a9-582ee94b0ec9-config-out\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngcj\" (UniqueName: \"kubernetes.io/projected/e2184647-a2d4-493d-b7a9-582ee94b0ec9-kube-api-access-tngcj\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154616 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154616 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2184647-a2d4-493d-b7a9-582ee94b0ec9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.154616 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.154462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2184647-a2d4-493d-b7a9-582ee94b0ec9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.230414 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.230375    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4304fa2b-5d19-412b-81dc-85be473819bc" path="/var/lib/kubelet/pods/4304fa2b-5d19-412b-81dc-85be473819bc/volumes"
Jul 17 14:53:49.255342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2184647-a2d4-493d-b7a9-582ee94b0ec9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255503 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255503 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255503 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-web-config\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255503 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2184647-a2d4-493d-b7a9-582ee94b0ec9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2184647-a2d4-493d-b7a9-582ee94b0ec9-config-out\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngcj\" (UniqueName: \"kubernetes.io/projected/e2184647-a2d4-493d-b7a9-582ee94b0ec9-kube-api-access-tngcj\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2184647-a2d4-493d-b7a9-582ee94b0ec9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.255683 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2184647-a2d4-493d-b7a9-582ee94b0ec9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.256020 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.255871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2184647-a2d4-493d-b7a9-582ee94b0ec9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.256161 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.256135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2184647-a2d4-493d-b7a9-582ee94b0ec9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.258608 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.258578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.258608 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.258578    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.258783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.258625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2184647-a2d4-493d-b7a9-582ee94b0ec9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.258783 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.258714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.258894 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.258853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-web-config\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.258931 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.258900    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.259010 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.258987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2184647-a2d4-493d-b7a9-582ee94b0ec9-config-out\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.259315 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.259290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2184647-a2d4-493d-b7a9-582ee94b0ec9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.259380 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.259364    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.260560 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.260544    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2184647-a2d4-493d-b7a9-582ee94b0ec9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.267068 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.267033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngcj\" (UniqueName: \"kubernetes.io/projected/e2184647-a2d4-493d-b7a9-582ee94b0ec9-kube-api-access-tngcj\") pod \"alertmanager-main-0\" (UID: \"e2184647-a2d4-493d-b7a9-582ee94b0ec9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.440542 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.440507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 14:53:49.582135 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:49.582111    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 14:53:49.583868 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:53:49.583845    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2184647_a2d4_493d_b7a9_582ee94b0ec9.slice/crio-0b2b66470e6cfdbd763419ffa1558096cf82221a48fbd23694dac25b7ea8ac40 WatchSource:0}: Error finding container 0b2b66470e6cfdbd763419ffa1558096cf82221a48fbd23694dac25b7ea8ac40: Status 404 returned error can't find the container with id 0b2b66470e6cfdbd763419ffa1558096cf82221a48fbd23694dac25b7ea8ac40
Jul 17 14:53:50.041870 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:50.041843    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2184647-a2d4-493d-b7a9-582ee94b0ec9" containerID="53a63e63451ef6b71eab71da14b84d900095352c05ca0f135d66fc2268c1890f" exitCode=0
Jul 17 14:53:50.042272 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:50.041922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerDied","Data":"53a63e63451ef6b71eab71da14b84d900095352c05ca0f135d66fc2268c1890f"}
Jul 17 14:53:50.042272 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:50.042008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerStarted","Data":"0b2b66470e6cfdbd763419ffa1558096cf82221a48fbd23694dac25b7ea8ac40"}
Jul 17 14:53:51.049875 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.049845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerStarted","Data":"fa058aa9322560122bc4ef512123ad12ee394a07c75dc9a5d6d832e05517a67e"}
Jul 17 14:53:51.050242 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.049934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerStarted","Data":"397d462b208fc4f3c06bc535f87bd2de1e8a7e143ca6b3a098917b661906e4f9"}
Jul 17 14:53:51.050242 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.049959    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerStarted","Data":"33e08fcf93011f21255056dcfe9056dc9f2f81f5febe8fa7b13c5f408899d738"}
Jul 17 14:53:51.050242 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.049988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerStarted","Data":"2bd3b02b2ab4679c7a6466dd406f3b6ee03d5be69cabf073fcd230219ef7bc09"}
Jul 17 14:53:51.050242 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.050012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerStarted","Data":"160ee217a19ac913da9dc434cb0d67f43035533ebd36298664c68a1b02830b68"}
Jul 17 14:53:51.050242 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.050033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2184647-a2d4-493d-b7a9-582ee94b0ec9","Type":"ContainerStarted","Data":"1e840ba59433cdae8a2cca94242b2fd5b262536531c6400a46ff453ade168d79"}
Jul 17 14:53:51.080326 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.080277    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.064054255 podStartE2EDuration="2.080263707s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.209452ms" isStatefulPod=false podCreationTimestamp="2026-07-17 14:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:53:51.078937848 +0000 UTC m=+244.277202216" watchObservedRunningTime="2026-07-17 14:53:51.080263707 +0000 UTC m=+244.278528044"
Jul 17 14:53:51.577550 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.577516    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c995f487c-t5mmk"]
Jul 17 14:53:51.581363 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.581343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.584118 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.584098    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 14:53:51.584237 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.584152    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 14:53:51.584537 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.584516    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kbj66\""
Jul 17 14:53:51.584664 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.584516    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 14:53:51.585463 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.585445    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 14:53:51.585564 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.585503    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 14:53:51.589412 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.589392    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 14:53:51.595387 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.595367    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c995f487c-t5mmk"]
Jul 17 14:53:51.674707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-serving-certs-ca-bundle\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.674707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-telemeter-client-tls\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.674925 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-federate-client-tls\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.674925 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-secret-telemeter-client\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.674925 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtw9r\" (UniqueName: \"kubernetes.io/projected/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-kube-api-access-gtw9r\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.674925 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.674925 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.675112 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.674931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-metrics-client-ca\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.775990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-metrics-client-ca\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.776080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-serving-certs-ca-bundle\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.776115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-telemeter-client-tls\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.776138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-federate-client-tls\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.776171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-secret-telemeter-client\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.776205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtw9r\" (UniqueName: \"kubernetes.io/projected/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-kube-api-access-gtw9r\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.776236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.776357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.777171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.777251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-serving-certs-ca-bundle\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.777746 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.777705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-metrics-client-ca\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.779369 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.779341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-telemeter-client-tls\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.779522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.779491    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-federate-client-tls\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.779522 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.779503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.779619 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.779489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-secret-telemeter-client\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.787396 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.787372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtw9r\" (UniqueName: \"kubernetes.io/projected/f6bc90b9-7dc2-490e-81a9-ebb82289edb2-kube-api-access-gtw9r\") pod \"telemeter-client-5c995f487c-t5mmk\" (UID: \"f6bc90b9-7dc2-490e-81a9-ebb82289edb2\") " pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:51.892111 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:51.892085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk"
Jul 17 14:53:52.047503 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:52.047472    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c995f487c-t5mmk"]
Jul 17 14:53:52.050094 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:53:52.050065    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bc90b9_7dc2_490e_81a9_ebb82289edb2.slice/crio-1d81a2d583b13bada09ceaa7d397cac33f4508d8cf27f53539daa0accbb1ba03 WatchSource:0}: Error finding container 1d81a2d583b13bada09ceaa7d397cac33f4508d8cf27f53539daa0accbb1ba03: Status 404 returned error can't find the container with id 1d81a2d583b13bada09ceaa7d397cac33f4508d8cf27f53539daa0accbb1ba03
Jul 17 14:53:53.059971 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:53.059886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk" event={"ID":"f6bc90b9-7dc2-490e-81a9-ebb82289edb2","Type":"ContainerStarted","Data":"1d81a2d583b13bada09ceaa7d397cac33f4508d8cf27f53539daa0accbb1ba03"}
Jul 17 14:53:54.066631 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.066547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk" event={"ID":"f6bc90b9-7dc2-490e-81a9-ebb82289edb2","Type":"ContainerStarted","Data":"04bc129dc0b1c307c9429cdd5a4f27a74a7fc1c34702d0258f8887f309aaabe9"}
Jul 17 14:53:54.066631 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.066602    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk" event={"ID":"f6bc90b9-7dc2-490e-81a9-ebb82289edb2","Type":"ContainerStarted","Data":"a8bcefe3a7fd4ea736ce2a975baf398312398310eec79fd18058d89e75a173b0"}
Jul 17 14:53:54.066631 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.066620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk" event={"ID":"f6bc90b9-7dc2-490e-81a9-ebb82289edb2","Type":"ContainerStarted","Data":"17cb17a2d96d39c9f4323a03db194863a2b372d8f03fb03f597abc4a43016c0f"}
Jul 17 14:53:54.092666 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.092612    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c995f487c-t5mmk" podStartSLOduration=1.506734827 podStartE2EDuration="3.092596107s" totalImagesPullingTime="1.58586128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:53:54.091897533 +0000 UTC m=+247.290161873" watchObservedRunningTime="2026-07-17 14:53:54.092596107 +0000 UTC m=+247.290860444"
Jul 17 14:53:54.832232 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.832178    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d85d6c9b-tkjwc"]
Jul 17 14:53:54.835929 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.835905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.846823 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.846801    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d85d6c9b-tkjwc"]
Jul 17 14:53:54.890258 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.890224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:53:54.902434 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.902408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-trusted-ca-bundle\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.902562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.902467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-oauth-serving-cert\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.902562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.902500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-oauth-config\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.902562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.902517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkf45\" (UniqueName: \"kubernetes.io/projected/a8cce409-0d91-4208-8239-0c2aedc70ed8-kube-api-access-rkf45\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.902562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.902535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-service-ca\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.902562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.902552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-config\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.902757 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.902575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-serving-cert\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:54.990342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:54.990311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:53:55.003535 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.003511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-oauth-serving-cert\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.003657 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.003542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-oauth-config\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.003657 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.003562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkf45\" (UniqueName: \"kubernetes.io/projected/a8cce409-0d91-4208-8239-0c2aedc70ed8-kube-api-access-rkf45\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.003773 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.003684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-service-ca\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.003773 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.003731    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-config\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.003871 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.003775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-serving-cert\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.003871 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.003816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-trusted-ca-bundle\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.004353 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.004324    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-oauth-serving-cert\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.004447 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.004354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-service-ca\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.004560 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.004515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-config\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.004971 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.004949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-trusted-ca-bundle\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.006824 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.006800    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-serving-cert\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.007332 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.007314    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-oauth-config\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.014688 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.014660    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkf45\" (UniqueName: \"kubernetes.io/projected/a8cce409-0d91-4208-8239-0c2aedc70ed8-kube-api-access-rkf45\") pod \"console-5d85d6c9b-tkjwc\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") " pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.147538 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.147520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:53:55.283578 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:55.283290    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d85d6c9b-tkjwc"]
Jul 17 14:53:55.286281 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:53:55.286249    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cce409_0d91_4208_8239_0c2aedc70ed8.slice/crio-b2db942b5b5feec90e82b7c0098172bc5d294010208298fd20d85a2dc76b904f WatchSource:0}: Error finding container b2db942b5b5feec90e82b7c0098172bc5d294010208298fd20d85a2dc76b904f: Status 404 returned error can't find the container with id b2db942b5b5feec90e82b7c0098172bc5d294010208298fd20d85a2dc76b904f
Jul 17 14:53:56.076521 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:56.076490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d85d6c9b-tkjwc" event={"ID":"a8cce409-0d91-4208-8239-0c2aedc70ed8","Type":"ContainerStarted","Data":"487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31"}
Jul 17 14:53:56.076653 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:56.076536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d85d6c9b-tkjwc" event={"ID":"a8cce409-0d91-4208-8239-0c2aedc70ed8","Type":"ContainerStarted","Data":"b2db942b5b5feec90e82b7c0098172bc5d294010208298fd20d85a2dc76b904f"}
Jul 17 14:53:56.099156 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:53:56.099086    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d85d6c9b-tkjwc" podStartSLOduration=2.099070387 podStartE2EDuration="2.099070387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:53:56.097942292 +0000 UTC m=+249.296206630" watchObservedRunningTime="2026-07-17 14:53:56.099070387 +0000 UTC m=+249.297334722"
Jul 17 14:54:05.148319 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:05.148281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:54:05.148707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:05.148467    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:54:05.152916 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:05.152898    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:54:06.115745 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:06.115717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:54:06.171654 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:06.171617    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576c94667c-7krdd"]
Jul 17 14:54:06.310123 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:06.310097    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:54:06.407575 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:06.407552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:54:06.474313 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:06.474262    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:54:15.517588 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:15.517498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:54:15.593701 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:15.593667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:54:31.193332 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.193264    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-576c94667c-7krdd" podUID="f47776d8-6b74-4817-b122-10d35c03d9f2" containerName="console" containerID="cri-o://99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852" gracePeriod=15
Jul 17 14:54:31.434809 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.434784    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:54:31.481561 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.481504    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:54:31.567220 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567195    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-service-ca\") pod \"f47776d8-6b74-4817-b122-10d35c03d9f2\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") "
Jul 17 14:54:31.567339 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567222    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmpz7\" (UniqueName: \"kubernetes.io/projected/f47776d8-6b74-4817-b122-10d35c03d9f2-kube-api-access-hmpz7\") pod \"f47776d8-6b74-4817-b122-10d35c03d9f2\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") "
Jul 17 14:54:31.567445 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567428    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-oauth-config\") pod \"f47776d8-6b74-4817-b122-10d35c03d9f2\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") "
Jul 17 14:54:31.567507 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567484    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-trusted-ca-bundle\") pod \"f47776d8-6b74-4817-b122-10d35c03d9f2\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") "
Jul 17 14:54:31.567562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567525    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-console-config\") pod \"f47776d8-6b74-4817-b122-10d35c03d9f2\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") "
Jul 17 14:54:31.567562 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567532    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "f47776d8-6b74-4817-b122-10d35c03d9f2" (UID: "f47776d8-6b74-4817-b122-10d35c03d9f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:54:31.567657 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567563    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-oauth-serving-cert\") pod \"f47776d8-6b74-4817-b122-10d35c03d9f2\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") "
Jul 17 14:54:31.567657 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567593    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-serving-cert\") pod \"f47776d8-6b74-4817-b122-10d35c03d9f2\" (UID: \"f47776d8-6b74-4817-b122-10d35c03d9f2\") "
Jul 17 14:54:31.567826 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567810    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-service-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:54:31.567909 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567874    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f47776d8-6b74-4817-b122-10d35c03d9f2" (UID: "f47776d8-6b74-4817-b122-10d35c03d9f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:54:31.567909 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567888    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-console-config" (OuterVolumeSpecName: "console-config") pod "f47776d8-6b74-4817-b122-10d35c03d9f2" (UID: "f47776d8-6b74-4817-b122-10d35c03d9f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:54:31.567909 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.567897    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f47776d8-6b74-4817-b122-10d35c03d9f2" (UID: "f47776d8-6b74-4817-b122-10d35c03d9f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:54:31.569329 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.569308    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f47776d8-6b74-4817-b122-10d35c03d9f2-kube-api-access-hmpz7" (OuterVolumeSpecName: "kube-api-access-hmpz7") pod "f47776d8-6b74-4817-b122-10d35c03d9f2" (UID: "f47776d8-6b74-4817-b122-10d35c03d9f2"). InnerVolumeSpecName "kube-api-access-hmpz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:54:31.569605 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.569585    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f47776d8-6b74-4817-b122-10d35c03d9f2" (UID: "f47776d8-6b74-4817-b122-10d35c03d9f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:54:31.569749 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.569733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f47776d8-6b74-4817-b122-10d35c03d9f2" (UID: "f47776d8-6b74-4817-b122-10d35c03d9f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:54:31.668738 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.668718    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-console-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:54:31.668738 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.668736    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-oauth-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:54:31.668855 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.668745    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:54:31.668855 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.668755    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmpz7\" (UniqueName: \"kubernetes.io/projected/f47776d8-6b74-4817-b122-10d35c03d9f2-kube-api-access-hmpz7\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:54:31.668855 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.668763    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f47776d8-6b74-4817-b122-10d35c03d9f2-console-oauth-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:54:31.668855 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:31.668772    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f47776d8-6b74-4817-b122-10d35c03d9f2-trusted-ca-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:54:32.204458 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.204423    2561 generic.go:356] "Generic (PLEG): container finished" podID="f47776d8-6b74-4817-b122-10d35c03d9f2" containerID="99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852" exitCode=0
Jul 17 14:54:32.204915 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.204480    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576c94667c-7krdd"
Jul 17 14:54:32.204915 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.204506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576c94667c-7krdd" event={"ID":"f47776d8-6b74-4817-b122-10d35c03d9f2","Type":"ContainerDied","Data":"99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852"}
Jul 17 14:54:32.204915 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.204552    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576c94667c-7krdd" event={"ID":"f47776d8-6b74-4817-b122-10d35c03d9f2","Type":"ContainerDied","Data":"23efb14cc33e3168d31760b227f2b53dc0bdca5cfe0abad8bb47488ec0631c85"}
Jul 17 14:54:32.204915 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.204574    2561 scope.go:117] "RemoveContainer" containerID="99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852"
Jul 17 14:54:32.213552 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.213537    2561 scope.go:117] "RemoveContainer" containerID="99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852"
Jul 17 14:54:32.213793 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:54:32.213775    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852\": container with ID starting with 99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852 not found: ID does not exist" containerID="99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852"
Jul 17 14:54:32.213861 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.213802    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852"} err="failed to get container status \"99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852\": rpc error: code = NotFound desc = could not find container \"99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852\": container with ID starting with 99cdb3974738a719b2e64e09347ebfbf1c003bfd2248b91dc565702b50e75852 not found: ID does not exist"
Jul 17 14:54:32.229018 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.228995    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576c94667c-7krdd"]
Jul 17 14:54:32.234890 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:32.234866    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-576c94667c-7krdd"]
Jul 17 14:54:33.231110 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:33.231080    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f47776d8-6b74-4817-b122-10d35c03d9f2" path="/var/lib/kubelet/pods/f47776d8-6b74-4817-b122-10d35c03d9f2/volumes"
Jul 17 14:54:47.106066 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:47.106025    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 14:54:47.110507 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:47.110460    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 14:54:47.110697 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:54:47.110684    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 14:55:01.817680 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:01.817644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:03.411171 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:03.411141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:11.045966 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.045933    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d768ff99-rl6k5"]
Jul 17 14:55:11.046405 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.046207    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47776d8-6b74-4817-b122-10d35c03d9f2" containerName="console"
Jul 17 14:55:11.046405 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.046217    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47776d8-6b74-4817-b122-10d35c03d9f2" containerName="console"
Jul 17 14:55:11.046405 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.046270    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f47776d8-6b74-4817-b122-10d35c03d9f2" containerName="console"
Jul 17 14:55:11.048997 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.048980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.061697 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.061676    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d768ff99-rl6k5"]
Jul 17 14:55:11.134970 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.134950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:11.135962 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.135945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-oauth-config\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.136013 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.135976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-service-ca\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.136062 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.136025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-serving-cert\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.136100 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.136068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-trusted-ca-bundle\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.136100 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.136088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-oauth-serving-cert\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.136165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.136113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-console-config\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.136165 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.136141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9bdl\" (UniqueName: \"kubernetes.io/projected/3ed37c26-51e8-44e8-9419-813af01226ff-kube-api-access-n9bdl\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.230337 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.230306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:11.237364 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.237347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9bdl\" (UniqueName: \"kubernetes.io/projected/3ed37c26-51e8-44e8-9419-813af01226ff-kube-api-access-n9bdl\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.237430 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.237388    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-oauth-config\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.237430 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.237409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-service-ca\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.237521 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.237433    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-serving-cert\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.237521 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.237450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-trusted-ca-bundle\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.237521 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.237464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-oauth-serving-cert\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.237521 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.237481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-console-config\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.238384 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.238357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-console-config\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.238490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.238358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-oauth-serving-cert\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.238490 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.238399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-trusted-ca-bundle\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.238599 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.238575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-service-ca\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.239980 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.239948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-oauth-config\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.240139 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.240122    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-serving-cert\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.247688 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.247661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9bdl\" (UniqueName: \"kubernetes.io/projected/3ed37c26-51e8-44e8-9419-813af01226ff-kube-api-access-n9bdl\") pod \"console-74d768ff99-rl6k5\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") " pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.332360 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.332300    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:11.358313 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.358284    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:11.493133 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:11.493110    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d768ff99-rl6k5"]
Jul 17 14:55:11.495794 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:55:11.495769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed37c26_51e8_44e8_9419_813af01226ff.slice/crio-1e56f24bcdb52bfb089eac25151d41248c746f2d32f6b1abbe6181d4cc239655 WatchSource:0}: Error finding container 1e56f24bcdb52bfb089eac25151d41248c746f2d32f6b1abbe6181d4cc239655: Status 404 returned error can't find the container with id 1e56f24bcdb52bfb089eac25151d41248c746f2d32f6b1abbe6181d4cc239655
Jul 17 14:55:12.048340 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:12.048276    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:12.146127 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:12.146084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:12.344936 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:12.344857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d768ff99-rl6k5" event={"ID":"3ed37c26-51e8-44e8-9419-813af01226ff","Type":"ContainerStarted","Data":"5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7"}
Jul 17 14:55:12.344936 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:12.344910    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d768ff99-rl6k5" event={"ID":"3ed37c26-51e8-44e8-9419-813af01226ff","Type":"ContainerStarted","Data":"1e56f24bcdb52bfb089eac25151d41248c746f2d32f6b1abbe6181d4cc239655"}
Jul 17 14:55:12.367914 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:12.367862    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d768ff99-rl6k5" podStartSLOduration=1.36784353 podStartE2EDuration="1.36784353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:55:12.367088328 +0000 UTC m=+325.565352667" watchObservedRunningTime="2026-07-17 14:55:12.36784353 +0000 UTC m=+325.566107867"
Jul 17 14:55:13.654648 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:13.654613    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:13.757563 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:13.757533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:21.359395 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:21.359342    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:21.359796 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:21.359415    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:21.364259 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:21.364228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:21.385994 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:21.385972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 14:55:21.450312 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:21.450280    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d85d6c9b-tkjwc"]
Jul 17 14:55:21.583082 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:21.583026    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:21.726422 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:21.726394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:25.007749 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:25.007699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:25.146577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:25.146544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:55:46.471055 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.471013    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d85d6c9b-tkjwc" podUID="a8cce409-0d91-4208-8239-0c2aedc70ed8" containerName="console" containerID="cri-o://487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31" gracePeriod=15
Jul 17 14:55:46.706253 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.706231    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:55:46.789515 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789457    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-trusted-ca-bundle\") pod \"a8cce409-0d91-4208-8239-0c2aedc70ed8\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") "
Jul 17 14:55:46.789515 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789492    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-oauth-serving-cert\") pod \"a8cce409-0d91-4208-8239-0c2aedc70ed8\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") "
Jul 17 14:55:46.789700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789520    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-serving-cert\") pod \"a8cce409-0d91-4208-8239-0c2aedc70ed8\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") "
Jul 17 14:55:46.789700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkf45\" (UniqueName: \"kubernetes.io/projected/a8cce409-0d91-4208-8239-0c2aedc70ed8-kube-api-access-rkf45\") pod \"a8cce409-0d91-4208-8239-0c2aedc70ed8\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") "
Jul 17 14:55:46.789700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789626    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-oauth-config\") pod \"a8cce409-0d91-4208-8239-0c2aedc70ed8\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") "
Jul 17 14:55:46.789700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789668    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-config\") pod \"a8cce409-0d91-4208-8239-0c2aedc70ed8\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") "
Jul 17 14:55:46.789700 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789695    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-service-ca\") pod \"a8cce409-0d91-4208-8239-0c2aedc70ed8\" (UID: \"a8cce409-0d91-4208-8239-0c2aedc70ed8\") "
Jul 17 14:55:46.789952 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789847    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8cce409-0d91-4208-8239-0c2aedc70ed8" (UID: "a8cce409-0d91-4208-8239-0c2aedc70ed8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:55:46.789952 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789883    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8cce409-0d91-4208-8239-0c2aedc70ed8" (UID: "a8cce409-0d91-4208-8239-0c2aedc70ed8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:55:46.789952 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.789929    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-trusted-ca-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:55:46.790185 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.790163    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-config" (OuterVolumeSpecName: "console-config") pod "a8cce409-0d91-4208-8239-0c2aedc70ed8" (UID: "a8cce409-0d91-4208-8239-0c2aedc70ed8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:55:46.790277 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.790257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8cce409-0d91-4208-8239-0c2aedc70ed8" (UID: "a8cce409-0d91-4208-8239-0c2aedc70ed8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 14:55:46.791843 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.791821    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8cce409-0d91-4208-8239-0c2aedc70ed8" (UID: "a8cce409-0d91-4208-8239-0c2aedc70ed8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:55:46.792227 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.792209    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8cce409-0d91-4208-8239-0c2aedc70ed8" (UID: "a8cce409-0d91-4208-8239-0c2aedc70ed8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 14:55:46.792288 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.792230    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8cce409-0d91-4208-8239-0c2aedc70ed8-kube-api-access-rkf45" (OuterVolumeSpecName: "kube-api-access-rkf45") pod "a8cce409-0d91-4208-8239-0c2aedc70ed8" (UID: "a8cce409-0d91-4208-8239-0c2aedc70ed8"). InnerVolumeSpecName "kube-api-access-rkf45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:55:46.890692 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.890670    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkf45\" (UniqueName: \"kubernetes.io/projected/a8cce409-0d91-4208-8239-0c2aedc70ed8-kube-api-access-rkf45\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:55:46.890692 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.890691    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-oauth-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:55:46.890807 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.890701    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:55:46.890807 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.890710    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-service-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:55:46.890807 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.890718    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8cce409-0d91-4208-8239-0c2aedc70ed8-oauth-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:55:46.890807 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:46.890725    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8cce409-0d91-4208-8239-0c2aedc70ed8-console-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:55:47.474341 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.474299    2561 generic.go:356] "Generic (PLEG): container finished" podID="a8cce409-0d91-4208-8239-0c2aedc70ed8" containerID="487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31" exitCode=0
Jul 17 14:55:47.474741 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.474350    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d85d6c9b-tkjwc"
Jul 17 14:55:47.474741 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.474357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d85d6c9b-tkjwc" event={"ID":"a8cce409-0d91-4208-8239-0c2aedc70ed8","Type":"ContainerDied","Data":"487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31"}
Jul 17 14:55:47.474741 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.474435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d85d6c9b-tkjwc" event={"ID":"a8cce409-0d91-4208-8239-0c2aedc70ed8","Type":"ContainerDied","Data":"b2db942b5b5feec90e82b7c0098172bc5d294010208298fd20d85a2dc76b904f"}
Jul 17 14:55:47.474741 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.474466    2561 scope.go:117] "RemoveContainer" containerID="487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31"
Jul 17 14:55:47.482477 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.482460    2561 scope.go:117] "RemoveContainer" containerID="487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31"
Jul 17 14:55:47.482736 ip-10-0-143-54 kubenswrapper[2561]: E0717 14:55:47.482715    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31\": container with ID starting with 487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31 not found: ID does not exist" containerID="487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31"
Jul 17 14:55:47.482821 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.482741    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31"} err="failed to get container status \"487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31\": rpc error: code = NotFound desc = could not find container \"487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31\": container with ID starting with 487a22a902800809858dd6b28c3dbda401a0ccdf95c7ade2ee0a9ba78f258c31 not found: ID does not exist"
Jul 17 14:55:47.493284 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.493232    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d85d6c9b-tkjwc"]
Jul 17 14:55:47.495432 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:47.495414    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d85d6c9b-tkjwc"]
Jul 17 14:55:49.230826 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:55:49.230785    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8cce409-0d91-4208-8239-0c2aedc70ed8" path="/var/lib/kubelet/pods/a8cce409-0d91-4208-8239-0c2aedc70ed8/volumes"
Jul 17 14:56:11.099684 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:11.099655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:11.191502 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:11.191468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:12.249196 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.249164    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"]
Jul 17 14:56:12.249577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.249445    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8cce409-0d91-4208-8239-0c2aedc70ed8" containerName="console"
Jul 17 14:56:12.249577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.249459    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8cce409-0d91-4208-8239-0c2aedc70ed8" containerName="console"
Jul 17 14:56:12.249577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.249506    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8cce409-0d91-4208-8239-0c2aedc70ed8" containerName="console"
Jul 17 14:56:12.252405 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.252389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.254996 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.254977    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9q6jb\""
Jul 17 14:56:12.255121 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.254977    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 14:56:12.255836 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.255821    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 14:56:12.263002 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.262980    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"]
Jul 17 14:56:12.371813 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.371784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.371949 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.371827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrc7g\" (UniqueName: \"kubernetes.io/projected/fa9f1f77-588c-4013-9f12-acca941dd39c-kube-api-access-wrc7g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.371949 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.371857    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.472364 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.472341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.472470 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.472378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrc7g\" (UniqueName: \"kubernetes.io/projected/fa9f1f77-588c-4013-9f12-acca941dd39c-kube-api-access-wrc7g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.472470 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.472409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.472730 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.472710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.472791 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.472738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.484086 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.484061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrc7g\" (UniqueName: \"kubernetes.io/projected/fa9f1f77-588c-4013-9f12-acca941dd39c-kube-api-access-wrc7g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.561607 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.561545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:12.689860 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.689837    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"]
Jul 17 14:56:12.692343 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:12.692312    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9f1f77_588c_4013_9f12_acca941dd39c.slice/crio-2a92499fd97e97b70671ca88ae86d762237f13b29e7c3407734b84f38f6bc62a WatchSource:0}: Error finding container 2a92499fd97e97b70671ca88ae86d762237f13b29e7c3407734b84f38f6bc62a: Status 404 returned error can't find the container with id 2a92499fd97e97b70671ca88ae86d762237f13b29e7c3407734b84f38f6bc62a
Jul 17 14:56:12.694189 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:12.694173    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 14:56:13.566829 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:13.566790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z" event={"ID":"fa9f1f77-588c-4013-9f12-acca941dd39c","Type":"ContainerStarted","Data":"2a92499fd97e97b70671ca88ae86d762237f13b29e7c3407734b84f38f6bc62a"}
Jul 17 14:56:19.591731 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:19.591694    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerID="e3670be9e12f8cdde3d3ce67665daf95d943b9a2e167c013a5bb6184bfc09067" exitCode=0
Jul 17 14:56:19.592202 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:19.591775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z" event={"ID":"fa9f1f77-588c-4013-9f12-acca941dd39c","Type":"ContainerDied","Data":"e3670be9e12f8cdde3d3ce67665daf95d943b9a2e167c013a5bb6184bfc09067"}
Jul 17 14:56:22.607052 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:22.607009    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerID="ebe425cbfd0dd91f234803b62bbdc322e4698f14d256989db22b479eed69892f" exitCode=0
Jul 17 14:56:22.607415 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:22.607104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z" event={"ID":"fa9f1f77-588c-4013-9f12-acca941dd39c","Type":"ContainerDied","Data":"ebe425cbfd0dd91f234803b62bbdc322e4698f14d256989db22b479eed69892f"}
Jul 17 14:56:29.637599 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:29.637569    2561 generic.go:356] "Generic (PLEG): container finished" podID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerID="3fd570203bcf0aa76e859864bbfe6ccd27a952072de928e106d145e6d1eb9708" exitCode=0
Jul 17 14:56:29.637985 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:29.637635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z" event={"ID":"fa9f1f77-588c-4013-9f12-acca941dd39c","Type":"ContainerDied","Data":"3fd570203bcf0aa76e859864bbfe6ccd27a952072de928e106d145e6d1eb9708"}
Jul 17 14:56:30.772815 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.772794    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:30.827225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.827199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrc7g\" (UniqueName: \"kubernetes.io/projected/fa9f1f77-588c-4013-9f12-acca941dd39c-kube-api-access-wrc7g\") pod \"fa9f1f77-588c-4013-9f12-acca941dd39c\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") "
Jul 17 14:56:30.827349 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.827258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-bundle\") pod \"fa9f1f77-588c-4013-9f12-acca941dd39c\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") "
Jul 17 14:56:30.827417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.827369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-util\") pod \"fa9f1f77-588c-4013-9f12-acca941dd39c\" (UID: \"fa9f1f77-588c-4013-9f12-acca941dd39c\") "
Jul 17 14:56:30.827893 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.827874    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-bundle" (OuterVolumeSpecName: "bundle") pod "fa9f1f77-588c-4013-9f12-acca941dd39c" (UID: "fa9f1f77-588c-4013-9f12-acca941dd39c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:56:30.829405 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.829384    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa9f1f77-588c-4013-9f12-acca941dd39c-kube-api-access-wrc7g" (OuterVolumeSpecName: "kube-api-access-wrc7g") pod "fa9f1f77-588c-4013-9f12-acca941dd39c" (UID: "fa9f1f77-588c-4013-9f12-acca941dd39c"). InnerVolumeSpecName "kube-api-access-wrc7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:56:30.831845 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.831816    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-util" (OuterVolumeSpecName: "util") pod "fa9f1f77-588c-4013-9f12-acca941dd39c" (UID: "fa9f1f77-588c-4013-9f12-acca941dd39c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:56:30.928353 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.928279    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrc7g\" (UniqueName: \"kubernetes.io/projected/fa9f1f77-588c-4013-9f12-acca941dd39c-kube-api-access-wrc7g\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:56:30.928353 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.928313    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:56:30.928353 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:30.928322    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9f1f77-588c-4013-9f12-acca941dd39c-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:56:31.647707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:31.647680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z" event={"ID":"fa9f1f77-588c-4013-9f12-acca941dd39c","Type":"ContainerDied","Data":"2a92499fd97e97b70671ca88ae86d762237f13b29e7c3407734b84f38f6bc62a"}
Jul 17 14:56:31.647707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:31.647711    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407jf7z"
Jul 17 14:56:31.647899 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:31.647729    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a92499fd97e97b70671ca88ae86d762237f13b29e7c3407734b84f38f6bc62a"
Jul 17 14:56:33.334623 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:33.334595    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:34.214766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:34.214721    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:34.658308 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:34.658284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:35.613006 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.612975    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"]
Jul 17 14:56:35.613288 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.613275    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerName="util"
Jul 17 14:56:35.613342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.613289    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerName="util"
Jul 17 14:56:35.613342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.613305    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerName="pull"
Jul 17 14:56:35.613342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.613310    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerName="pull"
Jul 17 14:56:35.613342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.613324    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerName="extract"
Jul 17 14:56:35.613342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.613330    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerName="extract"
Jul 17 14:56:35.613495 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.613372    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9f1f77-588c-4013-9f12-acca941dd39c" containerName="extract"
Jul 17 14:56:35.616907 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.616891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:35.619809 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.619778    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 17 14:56:35.620160 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.620143    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 17 14:56:35.620334 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.620318    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d7wtj\""
Jul 17 14:56:35.641324 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.641301    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"]
Jul 17 14:56:35.663331 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.663311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws24z\" (UniqueName: \"kubernetes.io/projected/dfc03ea9-0fcf-4abf-af6b-778a7722c00f-kube-api-access-ws24z\") pod \"cert-manager-operator-controller-manager-55c444bf86-bld98\" (UID: \"dfc03ea9-0fcf-4abf-af6b-778a7722c00f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:35.663625 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.663351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfc03ea9-0fcf-4abf-af6b-778a7722c00f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bld98\" (UID: \"dfc03ea9-0fcf-4abf-af6b-778a7722c00f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:35.763862 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.763842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfc03ea9-0fcf-4abf-af6b-778a7722c00f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bld98\" (UID: \"dfc03ea9-0fcf-4abf-af6b-778a7722c00f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:35.763969 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.763900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws24z\" (UniqueName: \"kubernetes.io/projected/dfc03ea9-0fcf-4abf-af6b-778a7722c00f-kube-api-access-ws24z\") pod \"cert-manager-operator-controller-manager-55c444bf86-bld98\" (UID: \"dfc03ea9-0fcf-4abf-af6b-778a7722c00f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:35.764209 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.764193    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfc03ea9-0fcf-4abf-af6b-778a7722c00f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bld98\" (UID: \"dfc03ea9-0fcf-4abf-af6b-778a7722c00f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:35.775590 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.775569    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws24z\" (UniqueName: \"kubernetes.io/projected/dfc03ea9-0fcf-4abf-af6b-778a7722c00f-kube-api-access-ws24z\") pod \"cert-manager-operator-controller-manager-55c444bf86-bld98\" (UID: \"dfc03ea9-0fcf-4abf-af6b-778a7722c00f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:35.925596 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:35.925569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"
Jul 17 14:56:36.058341 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:36.058319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98"]
Jul 17 14:56:36.060918 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:36.060894    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc03ea9_0fcf_4abf_af6b_778a7722c00f.slice/crio-37cead53695ccb44ba05db203d3b21b0e3f9e431a2f5fe67260be884c9bc7b51 WatchSource:0}: Error finding container 37cead53695ccb44ba05db203d3b21b0e3f9e431a2f5fe67260be884c9bc7b51: Status 404 returned error can't find the container with id 37cead53695ccb44ba05db203d3b21b0e3f9e431a2f5fe67260be884c9bc7b51
Jul 17 14:56:36.668315 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:36.668265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98" event={"ID":"dfc03ea9-0fcf-4abf-af6b-778a7722c00f","Type":"ContainerStarted","Data":"37cead53695ccb44ba05db203d3b21b0e3f9e431a2f5fe67260be884c9bc7b51"}
Jul 17 14:56:37.336140 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:37.336065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:37.437094 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:37.437056    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:37.674511 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:37.674484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98" event={"ID":"dfc03ea9-0fcf-4abf-af6b-778a7722c00f","Type":"ContainerStarted","Data":"f051034edb917ec95d0d6f262b7bfd8e7ad972b9df194eec9c398d8d66621f9c"}
Jul 17 14:56:37.712737 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:37.712693    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bld98" podStartSLOduration=1.25710309 podStartE2EDuration="2.71268019s" totalImagesPullingTime="1.4555771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:56:37.711241144 +0000 UTC m=+410.909505483" watchObservedRunningTime="2026-07-17 14:56:37.71268019 +0000 UTC m=+410.910944528"
Jul 17 14:56:38.193796 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:38.193763    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:38.407065 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:38.407021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:39.106752 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.106719    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"]
Jul 17 14:56:39.109932 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.109916    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.113311 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.113290    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9q6jb\""
Jul 17 14:56:39.113423 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.113335    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 14:56:39.113959 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.113945    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 14:56:39.131305 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.131276    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"]
Jul 17 14:56:39.194255 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.194236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.194360 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.194291    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.194420 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.194371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r6h9\" (UniqueName: \"kubernetes.io/projected/513a7728-99fc-4110-8544-5e90d8db7416-kube-api-access-7r6h9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.295314 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.295287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.295433 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.295332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r6h9\" (UniqueName: \"kubernetes.io/projected/513a7728-99fc-4110-8544-5e90d8db7416-kube-api-access-7r6h9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.295483 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.295445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.295648 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.295632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.295714 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.295698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.307680 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.307653    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r6h9\" (UniqueName: \"kubernetes.io/projected/513a7728-99fc-4110-8544-5e90d8db7416-kube-api-access-7r6h9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.418795 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.418770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:39.493062 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.493011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:39.565444 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.565420    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"]
Jul 17 14:56:39.567222 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:39.567190    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513a7728_99fc_4110_8544_5e90d8db7416.slice/crio-90cc8d398ad09953d96a152bcdcf3d8f47baa1e8fef21a716363eb91604582de WatchSource:0}: Error finding container 90cc8d398ad09953d96a152bcdcf3d8f47baa1e8fef21a716363eb91604582de: Status 404 returned error can't find the container with id 90cc8d398ad09953d96a152bcdcf3d8f47baa1e8fef21a716363eb91604582de
Jul 17 14:56:39.603359 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.603334    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:39.683765 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.683735    2561 generic.go:356] "Generic (PLEG): container finished" podID="513a7728-99fc-4110-8544-5e90d8db7416" containerID="b4369f1eb8205d467829abbabb459e4a6dddcd1e0af45a2f4644f737586d68cf" exitCode=0
Jul 17 14:56:39.683873 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.683816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4" event={"ID":"513a7728-99fc-4110-8544-5e90d8db7416","Type":"ContainerDied","Data":"b4369f1eb8205d467829abbabb459e4a6dddcd1e0af45a2f4644f737586d68cf"}
Jul 17 14:56:39.683873 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:39.683863    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4" event={"ID":"513a7728-99fc-4110-8544-5e90d8db7416","Type":"ContainerStarted","Data":"90cc8d398ad09953d96a152bcdcf3d8f47baa1e8fef21a716363eb91604582de"}
Jul 17 14:56:41.586893 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.586862    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qw56b"]
Jul 17 14:56:41.598003 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.597568    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.600293 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.600249    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qw56b"]
Jul 17 14:56:41.600886 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.600861    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 14:56:41.601904 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.601850    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-k4fjq\""
Jul 17 14:56:41.601904 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.601865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 14:56:41.715247 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.715218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlfng\" (UniqueName: \"kubernetes.io/projected/d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2-kube-api-access-xlfng\") pod \"cert-manager-webhook-6486ffd997-qw56b\" (UID: \"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.715444 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.715252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qw56b\" (UID: \"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.816025 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.816002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlfng\" (UniqueName: \"kubernetes.io/projected/d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2-kube-api-access-xlfng\") pod \"cert-manager-webhook-6486ffd997-qw56b\" (UID: \"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.816141 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.816034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qw56b\" (UID: \"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.826998 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.826980    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qw56b\" (UID: \"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.827254 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.827232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlfng\" (UniqueName: \"kubernetes.io/projected/d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2-kube-api-access-xlfng\") pod \"cert-manager-webhook-6486ffd997-qw56b\" (UID: \"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.920676 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.920647    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:41.926186 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:41.926166    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:42.051537 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.051506    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qw56b"]
Jul 17 14:56:42.053187 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:42.053162    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0a0eb81_a8d6_40e3_bcaf_c56a6bfa65a2.slice/crio-309ceb5aab721177bd2b05b1f45cee3de4ff22f49ceef6ccb14c718e59e32583 WatchSource:0}: Error finding container 309ceb5aab721177bd2b05b1f45cee3de4ff22f49ceef6ccb14c718e59e32583: Status 404 returned error can't find the container with id 309ceb5aab721177bd2b05b1f45cee3de4ff22f49ceef6ccb14c718e59e32583
Jul 17 14:56:42.141638 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.141608    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:42.698454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.698424    2561 generic.go:356] "Generic (PLEG): container finished" podID="513a7728-99fc-4110-8544-5e90d8db7416" containerID="6d415382e63cb48e67087bc0ffd7d296a6525efc90281ac58acb739c2a3e6179" exitCode=0
Jul 17 14:56:42.698873 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.698483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4" event={"ID":"513a7728-99fc-4110-8544-5e90d8db7416","Type":"ContainerDied","Data":"6d415382e63cb48e67087bc0ffd7d296a6525efc90281ac58acb739c2a3e6179"}
Jul 17 14:56:42.699701 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.699679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b" event={"ID":"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2","Type":"ContainerStarted","Data":"309ceb5aab721177bd2b05b1f45cee3de4ff22f49ceef6ccb14c718e59e32583"}
Jul 17 14:56:42.869297 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.869272    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"]
Jul 17 14:56:42.872603 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.872580    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:42.875095 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.875070    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5xbc2\""
Jul 17 14:56:42.883252 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.883228    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"]
Jul 17 14:56:42.924232 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.924207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d2fee88-490e-4add-adc8-716d753bbfa0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ff7q2\" (UID: \"7d2fee88-490e-4add-adc8-716d753bbfa0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:42.924362 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:42.924298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8hpd\" (UniqueName: \"kubernetes.io/projected/7d2fee88-490e-4add-adc8-716d753bbfa0-kube-api-access-d8hpd\") pod \"cert-manager-cainjector-559cdd8c87-ff7q2\" (UID: \"7d2fee88-490e-4add-adc8-716d753bbfa0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:43.025174 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.025138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8hpd\" (UniqueName: \"kubernetes.io/projected/7d2fee88-490e-4add-adc8-716d753bbfa0-kube-api-access-d8hpd\") pod \"cert-manager-cainjector-559cdd8c87-ff7q2\" (UID: \"7d2fee88-490e-4add-adc8-716d753bbfa0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:43.025317 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.025203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d2fee88-490e-4add-adc8-716d753bbfa0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ff7q2\" (UID: \"7d2fee88-490e-4add-adc8-716d753bbfa0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:43.035425 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.035391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8hpd\" (UniqueName: \"kubernetes.io/projected/7d2fee88-490e-4add-adc8-716d753bbfa0-kube-api-access-d8hpd\") pod \"cert-manager-cainjector-559cdd8c87-ff7q2\" (UID: \"7d2fee88-490e-4add-adc8-716d753bbfa0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:43.035898 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.035874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d2fee88-490e-4add-adc8-716d753bbfa0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ff7q2\" (UID: \"7d2fee88-490e-4add-adc8-716d753bbfa0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:43.184363 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.184337    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"
Jul 17 14:56:43.347957 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.347928    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2"]
Jul 17 14:56:43.353577 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:43.353548    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d2fee88_490e_4add_adc8_716d753bbfa0.slice/crio-f42e5e593db7a8f5dfc6565979612bd2cd01a0da22816fa35aeae34792d0d867 WatchSource:0}: Error finding container f42e5e593db7a8f5dfc6565979612bd2cd01a0da22816fa35aeae34792d0d867: Status 404 returned error can't find the container with id f42e5e593db7a8f5dfc6565979612bd2cd01a0da22816fa35aeae34792d0d867
Jul 17 14:56:43.706185 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.706148    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2" event={"ID":"7d2fee88-490e-4add-adc8-716d753bbfa0","Type":"ContainerStarted","Data":"f42e5e593db7a8f5dfc6565979612bd2cd01a0da22816fa35aeae34792d0d867"}
Jul 17 14:56:43.708660 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.708626    2561 generic.go:356] "Generic (PLEG): container finished" podID="513a7728-99fc-4110-8544-5e90d8db7416" containerID="7c6103d9ee0e7fe4e917ffb762d33d96766418500bb1ec09160b55dcd4884d80" exitCode=0
Jul 17 14:56:43.708792 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.708710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4" event={"ID":"513a7728-99fc-4110-8544-5e90d8db7416","Type":"ContainerDied","Data":"7c6103d9ee0e7fe4e917ffb762d33d96766418500bb1ec09160b55dcd4884d80"}
Jul 17 14:56:43.943765 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:43.943718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:44.008879 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:44.008792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:44.927692 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:44.927671    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:45.041288 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.041211    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r6h9\" (UniqueName: \"kubernetes.io/projected/513a7728-99fc-4110-8544-5e90d8db7416-kube-api-access-7r6h9\") pod \"513a7728-99fc-4110-8544-5e90d8db7416\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") "
Jul 17 14:56:45.041288 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.041265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-util\") pod \"513a7728-99fc-4110-8544-5e90d8db7416\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") "
Jul 17 14:56:45.041480 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.041292    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-bundle\") pod \"513a7728-99fc-4110-8544-5e90d8db7416\" (UID: \"513a7728-99fc-4110-8544-5e90d8db7416\") "
Jul 17 14:56:45.041672 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.041646    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-bundle" (OuterVolumeSpecName: "bundle") pod "513a7728-99fc-4110-8544-5e90d8db7416" (UID: "513a7728-99fc-4110-8544-5e90d8db7416"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:56:45.043501 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.043481    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513a7728-99fc-4110-8544-5e90d8db7416-kube-api-access-7r6h9" (OuterVolumeSpecName: "kube-api-access-7r6h9") pod "513a7728-99fc-4110-8544-5e90d8db7416" (UID: "513a7728-99fc-4110-8544-5e90d8db7416"). InnerVolumeSpecName "kube-api-access-7r6h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:56:45.045094 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.045076    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-util" (OuterVolumeSpecName: "util") pod "513a7728-99fc-4110-8544-5e90d8db7416" (UID: "513a7728-99fc-4110-8544-5e90d8db7416"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:56:45.142324 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.142284    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r6h9\" (UniqueName: \"kubernetes.io/projected/513a7728-99fc-4110-8544-5e90d8db7416-kube-api-access-7r6h9\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:56:45.142324 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.142321    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:56:45.142546 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.142334    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513a7728-99fc-4110-8544-5e90d8db7416-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:56:45.717958 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.717919    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2" event={"ID":"7d2fee88-490e-4add-adc8-716d753bbfa0","Type":"ContainerStarted","Data":"010849b1300319e752d3ab3847ddf886bd82665a6c379732b8de2f2b73bcb5b0"}
Jul 17 14:56:45.719773 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.719753    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4"
Jul 17 14:56:45.719896 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.719770    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9hj4" event={"ID":"513a7728-99fc-4110-8544-5e90d8db7416","Type":"ContainerDied","Data":"90cc8d398ad09953d96a152bcdcf3d8f47baa1e8fef21a716363eb91604582de"}
Jul 17 14:56:45.719896 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.719829    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90cc8d398ad09953d96a152bcdcf3d8f47baa1e8fef21a716363eb91604582de"
Jul 17 14:56:45.721225 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.721200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b" event={"ID":"d0a0eb81-a8d6-40e3-bcaf-c56a6bfa65a2","Type":"ContainerStarted","Data":"a50415bcc57b5c187e5ee45cf9eaadb827cdcc4ee6a04117831f96d242bd4471"}
Jul 17 14:56:45.721364 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.721347    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:45.739448 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.739412    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ff7q2" podStartSLOduration=2.2869325050000002 podStartE2EDuration="3.73939902s" totalImagesPullingTime="1.452466515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:56:45.737589727 +0000 UTC m=+418.935854065" watchObservedRunningTime="2026-07-17 14:56:45.73939902 +0000 UTC m=+418.937663336"
Jul 17 14:56:45.759625 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:45.759588    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b" podStartSLOduration=2.007252617 podStartE2EDuration="4.759577063s" totalImagesPullingTime="2.752324446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:56:45.758208424 +0000 UTC m=+418.956472763" watchObservedRunningTime="2026-07-17 14:56:45.759577063 +0000 UTC m=+418.957841400"
Jul 17 14:56:47.412665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:47.412595    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:47.492167 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:47.492142    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:49.392174 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392144    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"]
Jul 17 14:56:49.392592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392401    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513a7728-99fc-4110-8544-5e90d8db7416" containerName="extract"
Jul 17 14:56:49.392592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392410    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="513a7728-99fc-4110-8544-5e90d8db7416" containerName="extract"
Jul 17 14:56:49.392592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392428    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513a7728-99fc-4110-8544-5e90d8db7416" containerName="util"
Jul 17 14:56:49.392592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392433    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="513a7728-99fc-4110-8544-5e90d8db7416" containerName="util"
Jul 17 14:56:49.392592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392447    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513a7728-99fc-4110-8544-5e90d8db7416" containerName="pull"
Jul 17 14:56:49.392592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392453    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="513a7728-99fc-4110-8544-5e90d8db7416" containerName="pull"
Jul 17 14:56:49.392592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.392492    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="513a7728-99fc-4110-8544-5e90d8db7416" containerName="extract"
Jul 17 14:56:49.399069 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.399032    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.401737 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.401719    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 14:56:49.401835 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.401745    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 14:56:49.401999 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.401983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rm2j8\""
Jul 17 14:56:49.404826 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.404806    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"]
Jul 17 14:56:49.471759 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.471727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a910faa5-adc3-4950-a35e-ed0bfd4e5810-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nsdq5\" (UID: \"a910faa5-adc3-4950-a35e-ed0bfd4e5810\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.471919 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.471828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgfkc\" (UniqueName: \"kubernetes.io/projected/a910faa5-adc3-4950-a35e-ed0bfd4e5810-kube-api-access-lgfkc\") pod \"openshift-lws-operator-fd8ccff4c-nsdq5\" (UID: \"a910faa5-adc3-4950-a35e-ed0bfd4e5810\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.522707 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.522681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:49.572853 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.572825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a910faa5-adc3-4950-a35e-ed0bfd4e5810-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nsdq5\" (UID: \"a910faa5-adc3-4950-a35e-ed0bfd4e5810\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.572963 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.572897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgfkc\" (UniqueName: \"kubernetes.io/projected/a910faa5-adc3-4950-a35e-ed0bfd4e5810-kube-api-access-lgfkc\") pod \"openshift-lws-operator-fd8ccff4c-nsdq5\" (UID: \"a910faa5-adc3-4950-a35e-ed0bfd4e5810\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.573234 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.573217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a910faa5-adc3-4950-a35e-ed0bfd4e5810-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nsdq5\" (UID: \"a910faa5-adc3-4950-a35e-ed0bfd4e5810\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.583521 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.583502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgfkc\" (UniqueName: \"kubernetes.io/projected/a910faa5-adc3-4950-a35e-ed0bfd4e5810-kube-api-access-lgfkc\") pod \"openshift-lws-operator-fd8ccff4c-nsdq5\" (UID: \"a910faa5-adc3-4950-a35e-ed0bfd4e5810\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.625064 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.625020    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-df2kk"]
Jul 17 14:56:49.628150 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.628137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:49.630603 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.630587    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5zxfx\""
Jul 17 14:56:49.637123 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.637104    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-df2kk"]
Jul 17 14:56:49.674298 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.674238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05b925c0-2c3a-42a3-a674-c9381ec93bc4-bound-sa-token\") pod \"cert-manager-55b4d954d5-df2kk\" (UID: \"05b925c0-2c3a-42a3-a674-c9381ec93bc4\") " pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:49.674298 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.674286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cndkk\" (UniqueName: \"kubernetes.io/projected/05b925c0-2c3a-42a3-a674-c9381ec93bc4-kube-api-access-cndkk\") pod \"cert-manager-55b4d954d5-df2kk\" (UID: \"05b925c0-2c3a-42a3-a674-c9381ec93bc4\") " pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:49.709352 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.709330    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"
Jul 17 14:56:49.775226 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.775190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cndkk\" (UniqueName: \"kubernetes.io/projected/05b925c0-2c3a-42a3-a674-c9381ec93bc4-kube-api-access-cndkk\") pod \"cert-manager-55b4d954d5-df2kk\" (UID: \"05b925c0-2c3a-42a3-a674-c9381ec93bc4\") " pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:49.775375 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.775280    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05b925c0-2c3a-42a3-a674-c9381ec93bc4-bound-sa-token\") pod \"cert-manager-55b4d954d5-df2kk\" (UID: \"05b925c0-2c3a-42a3-a674-c9381ec93bc4\") " pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:49.785019 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.784967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05b925c0-2c3a-42a3-a674-c9381ec93bc4-bound-sa-token\") pod \"cert-manager-55b4d954d5-df2kk\" (UID: \"05b925c0-2c3a-42a3-a674-c9381ec93bc4\") " pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:49.787210 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.787181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cndkk\" (UniqueName: \"kubernetes.io/projected/05b925c0-2c3a-42a3-a674-c9381ec93bc4-kube-api-access-cndkk\") pod \"cert-manager-55b4d954d5-df2kk\" (UID: \"05b925c0-2c3a-42a3-a674-c9381ec93bc4\") " pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:49.857194 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.857172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5"]
Jul 17 14:56:49.859292 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:49.859264    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda910faa5_adc3_4950_a35e_ed0bfd4e5810.slice/crio-7490bfc3452c4e4ed637ad517544cfd7264c8a5c067166bed6d714d3f5b65cb8 WatchSource:0}: Error finding container 7490bfc3452c4e4ed637ad517544cfd7264c8a5c067166bed6d714d3f5b65cb8: Status 404 returned error can't find the container with id 7490bfc3452c4e4ed637ad517544cfd7264c8a5c067166bed6d714d3f5b65cb8
Jul 17 14:56:49.938278 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:49.938221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-df2kk"
Jul 17 14:56:50.093581 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:50.093554    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-df2kk"]
Jul 17 14:56:50.094767 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:50.094745    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05b925c0_2c3a_42a3_a674_c9381ec93bc4.slice/crio-4651fe21d5d86d7849724ad4bf2e444668fac4e4cb726089800e3f530ffe74b5 WatchSource:0}: Error finding container 4651fe21d5d86d7849724ad4bf2e444668fac4e4cb726089800e3f530ffe74b5: Status 404 returned error can't find the container with id 4651fe21d5d86d7849724ad4bf2e444668fac4e4cb726089800e3f530ffe74b5
Jul 17 14:56:50.745749 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:50.745711    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5" event={"ID":"a910faa5-adc3-4950-a35e-ed0bfd4e5810","Type":"ContainerStarted","Data":"7490bfc3452c4e4ed637ad517544cfd7264c8a5c067166bed6d714d3f5b65cb8"}
Jul 17 14:56:50.747439 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:50.747412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-df2kk" event={"ID":"05b925c0-2c3a-42a3-a674-c9381ec93bc4","Type":"ContainerStarted","Data":"1334467f98aac5bba6bb6f2be32a99718d73d71982d9117abc1b8572cc58aeb0"}
Jul 17 14:56:50.747578 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:50.747446    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-df2kk" event={"ID":"05b925c0-2c3a-42a3-a674-c9381ec93bc4","Type":"ContainerStarted","Data":"4651fe21d5d86d7849724ad4bf2e444668fac4e4cb726089800e3f530ffe74b5"}
Jul 17 14:56:50.767254 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:50.767210    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-df2kk" podStartSLOduration=1.7671964660000001 podStartE2EDuration="1.767196466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:56:50.765688037 +0000 UTC m=+423.963952377" watchObservedRunningTime="2026-07-17 14:56:50.767196466 +0000 UTC m=+423.965460782"
Jul 17 14:56:51.727396 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:51.727369    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qw56b"
Jul 17 14:56:52.760132 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:52.760103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5" event={"ID":"a910faa5-adc3-4950-a35e-ed0bfd4e5810","Type":"ContainerStarted","Data":"cad098f9a05e6ce1815f87e541f251befda4d4b0b15048de693658e94058e9dc"}
Jul 17 14:56:52.778597 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:52.778553    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nsdq5" podStartSLOduration=1.622294925 podStartE2EDuration="3.778537115s" totalImagesPullingTime="2.15624219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:56:52.778316148 +0000 UTC m=+425.976580490" watchObservedRunningTime="2026-07-17 14:56:52.778537115 +0000 UTC m=+425.976801452"
Jul 17 14:56:53.642166 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:53.642136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:53.734870 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:53.734836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:55.245132 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.245095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:55.829747 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.829710    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"]
Jul 17 14:56:55.833379 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.833358    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:55.835995 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.835971    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 14:56:55.836174 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.836027    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9q6jb\""
Jul 17 14:56:55.836174 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.835972    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 14:56:55.842946 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.842920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"]
Jul 17 14:56:55.925558 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.925522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:55.925714 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.925560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xj2c\" (UniqueName: \"kubernetes.io/projected/ca8676bc-adb0-43c4-8978-3609d9e9d919-kube-api-access-4xj2c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:55.925714 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:55.925595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.026660 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.026631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.026823 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.026665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xj2c\" (UniqueName: \"kubernetes.io/projected/ca8676bc-adb0-43c4-8978-3609d9e9d919-kube-api-access-4xj2c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.026823 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.026688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.027019 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.026999    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.027019 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.027013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.036306 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.036287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xj2c\" (UniqueName: \"kubernetes.io/projected/ca8676bc-adb0-43c4-8978-3609d9e9d919-kube-api-access-4xj2c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.143758 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.143733    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:56:56.276712 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.276689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"]
Jul 17 14:56:56.279119 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:56:56.279086    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8676bc_adb0_43c4_8978_3609d9e9d919.slice/crio-a82b9546a30748c02e5875c1938199849f264359cfae8010f3f45857f7272490 WatchSource:0}: Error finding container a82b9546a30748c02e5875c1938199849f264359cfae8010f3f45857f7272490: Status 404 returned error can't find the container with id a82b9546a30748c02e5875c1938199849f264359cfae8010f3f45857f7272490
Jul 17 14:56:56.778519 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.778488    2561 generic.go:356] "Generic (PLEG): container finished" podID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerID="9803f6f55eb6957f2fd1115c5e319b2a0edf72164fafcb810a495b5c14f8ae40" exitCode=0
Jul 17 14:56:56.778670 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.778573    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf" event={"ID":"ca8676bc-adb0-43c4-8978-3609d9e9d919","Type":"ContainerDied","Data":"9803f6f55eb6957f2fd1115c5e319b2a0edf72164fafcb810a495b5c14f8ae40"}
Jul 17 14:56:56.778670 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:56.778620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf" event={"ID":"ca8676bc-adb0-43c4-8978-3609d9e9d919","Type":"ContainerStarted","Data":"a82b9546a30748c02e5875c1938199849f264359cfae8010f3f45857f7272490"}
Jul 17 14:56:57.623485 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:57.623455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:56:57.784390 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:57.784368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf" event={"ID":"ca8676bc-adb0-43c4-8978-3609d9e9d919","Type":"ContainerStarted","Data":"b9b89aa6aa4d828da593eede62020d02a4c9284b6943eae9f71ba02f08edc856"}
Jul 17 14:56:58.790022 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:58.789991    2561 generic.go:356] "Generic (PLEG): container finished" podID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerID="b9b89aa6aa4d828da593eede62020d02a4c9284b6943eae9f71ba02f08edc856" exitCode=0
Jul 17 14:56:58.790400 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:58.790086    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf" event={"ID":"ca8676bc-adb0-43c4-8978-3609d9e9d919","Type":"ContainerDied","Data":"b9b89aa6aa4d828da593eede62020d02a4c9284b6943eae9f71ba02f08edc856"}
Jul 17 14:56:59.798058 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:59.798010    2561 generic.go:356] "Generic (PLEG): container finished" podID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerID="f423c140b07dbe702dc50753d01aa80239514b1d5d4701cbaad83934d8e8f884" exitCode=0
Jul 17 14:56:59.798413 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:56:59.798080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf" event={"ID":"ca8676bc-adb0-43c4-8978-3609d9e9d919","Type":"ContainerDied","Data":"f423c140b07dbe702dc50753d01aa80239514b1d5d4701cbaad83934d8e8f884"}
Jul 17 14:57:00.697741 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:00.697698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:00.798125 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:00.798078    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:00.927271 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:00.927248    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:57:01.064144 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.064075    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-bundle\") pod \"ca8676bc-adb0-43c4-8978-3609d9e9d919\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") "
Jul 17 14:57:01.064144 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.064142    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xj2c\" (UniqueName: \"kubernetes.io/projected/ca8676bc-adb0-43c4-8978-3609d9e9d919-kube-api-access-4xj2c\") pod \"ca8676bc-adb0-43c4-8978-3609d9e9d919\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") "
Jul 17 14:57:01.064311 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.064165    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-util\") pod \"ca8676bc-adb0-43c4-8978-3609d9e9d919\" (UID: \"ca8676bc-adb0-43c4-8978-3609d9e9d919\") "
Jul 17 14:57:01.064800 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.064774    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-bundle" (OuterVolumeSpecName: "bundle") pod "ca8676bc-adb0-43c4-8978-3609d9e9d919" (UID: "ca8676bc-adb0-43c4-8978-3609d9e9d919"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:57:01.066287 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.066255    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca8676bc-adb0-43c4-8978-3609d9e9d919-kube-api-access-4xj2c" (OuterVolumeSpecName: "kube-api-access-4xj2c") pod "ca8676bc-adb0-43c4-8978-3609d9e9d919" (UID: "ca8676bc-adb0-43c4-8978-3609d9e9d919"). InnerVolumeSpecName "kube-api-access-4xj2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:57:01.069638 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.069621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-util" (OuterVolumeSpecName: "util") pod "ca8676bc-adb0-43c4-8978-3609d9e9d919" (UID: "ca8676bc-adb0-43c4-8978-3609d9e9d919"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:57:01.164960 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.164929    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:57:01.165101 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.164963    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xj2c\" (UniqueName: \"kubernetes.io/projected/ca8676bc-adb0-43c4-8978-3609d9e9d919-kube-api-access-4xj2c\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:57:01.165101 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.164981    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca8676bc-adb0-43c4-8978-3609d9e9d919-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:57:01.808181 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.808145    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf" event={"ID":"ca8676bc-adb0-43c4-8978-3609d9e9d919","Type":"ContainerDied","Data":"a82b9546a30748c02e5875c1938199849f264359cfae8010f3f45857f7272490"}
Jul 17 14:57:01.808181 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.808171    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afht9jf"
Jul 17 14:57:01.808611 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:01.808202    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a82b9546a30748c02e5875c1938199849f264359cfae8010f3f45857f7272490"
Jul 17 14:57:02.106220 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:02.106145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:02.187545 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:02.187517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:08.556866 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:08.556770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:08.677763 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:08.677727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:09.174582 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.174554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:09.726588 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.726544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:09.828247 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.828209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:09.976454 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976422    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"]
Jul 17 14:57:09.976737 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976697    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerName="extract"
Jul 17 14:57:09.976737 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976710    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerName="extract"
Jul 17 14:57:09.976737 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976730    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerName="pull"
Jul 17 14:57:09.976737 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976735    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerName="pull"
Jul 17 14:57:09.976895 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976742    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerName="util"
Jul 17 14:57:09.976895 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976747    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerName="util"
Jul 17 14:57:09.976895 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.976791    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca8676bc-adb0-43c4-8978-3609d9e9d919" containerName="extract"
Jul 17 14:57:09.979726 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.979708    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:09.983260 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.983238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ndbhs\""
Jul 17 14:57:09.983497 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.983479    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 14:57:09.983577 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.983488    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 14:57:09.983800 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.983785    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 14:57:09.984063 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:09.984029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 14:57:10.013105 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.013086    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"]
Jul 17 14:57:10.130948 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.130922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edc1644f-752b-40e1-856e-8ba454b1cdae-manifests\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.130948 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.130950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edc1644f-752b-40e1-856e-8ba454b1cdae-tmp\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.131169 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.130973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94hlc\" (UniqueName: \"kubernetes.io/projected/edc1644f-752b-40e1-856e-8ba454b1cdae-kube-api-access-94hlc\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.131169 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.131016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc1644f-752b-40e1-856e-8ba454b1cdae-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.131169 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.131125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edc1644f-752b-40e1-856e-8ba454b1cdae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.232325 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.232260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edc1644f-752b-40e1-856e-8ba454b1cdae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.232435 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.232329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edc1644f-752b-40e1-856e-8ba454b1cdae-manifests\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.232435 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.232353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edc1644f-752b-40e1-856e-8ba454b1cdae-tmp\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.232435 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.232372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94hlc\" (UniqueName: \"kubernetes.io/projected/edc1644f-752b-40e1-856e-8ba454b1cdae-kube-api-access-94hlc\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.232435 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.232398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc1644f-752b-40e1-856e-8ba454b1cdae-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.232806 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.232789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/edc1644f-752b-40e1-856e-8ba454b1cdae-manifests\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.234817 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.234794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edc1644f-752b-40e1-856e-8ba454b1cdae-tmp\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.235010 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.234990    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/edc1644f-752b-40e1-856e-8ba454b1cdae-webhook-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.235074 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.235059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/edc1644f-752b-40e1-856e-8ba454b1cdae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.247241 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.247221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94hlc\" (UniqueName: \"kubernetes.io/projected/edc1644f-752b-40e1-856e-8ba454b1cdae-kube-api-access-94hlc\") pod \"opendatahub-operator-controller-manager-dcf5668f8-kcbvh\" (UID: \"edc1644f-752b-40e1-856e-8ba454b1cdae\") " pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.290143 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.290121    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:10.318173 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.318143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:10.429585 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.429549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:10.450405 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.450385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"]
Jul 17 14:57:10.452202 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:57:10.452179    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc1644f_752b_40e1_856e_8ba454b1cdae.slice/crio-6992c4d096ee06cc387c9b16db51a9fa03fc73d8356f7ea2abdcaa7134c47df9 WatchSource:0}: Error finding container 6992c4d096ee06cc387c9b16db51a9fa03fc73d8356f7ea2abdcaa7134c47df9: Status 404 returned error can't find the container with id 6992c4d096ee06cc387c9b16db51a9fa03fc73d8356f7ea2abdcaa7134c47df9
Jul 17 14:57:10.560897 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.560834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:10.674056 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.674004    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:10.775506 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.775484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:10.852952 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.852878    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh" event={"ID":"edc1644f-752b-40e1-856e-8ba454b1cdae","Type":"ContainerStarted","Data":"6992c4d096ee06cc387c9b16db51a9fa03fc73d8356f7ea2abdcaa7134c47df9"}
Jul 17 14:57:10.890688 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:10.890662    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:11.001066 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:11.001023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:13.868508 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:13.868473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh" event={"ID":"edc1644f-752b-40e1-856e-8ba454b1cdae","Type":"ContainerStarted","Data":"f7b8dc3ca8fc10aa78b83ecaeab5f69405030921a1141839fa538346a59625da"}
Jul 17 14:57:14.874754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:14.874668    2561 generic.go:356] "Generic (PLEG): container finished" podID="edc1644f-752b-40e1-856e-8ba454b1cdae" containerID="f7b8dc3ca8fc10aa78b83ecaeab5f69405030921a1141839fa538346a59625da" exitCode=0
Jul 17 14:57:14.875136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:14.874750    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh" event={"ID":"edc1644f-752b-40e1-856e-8ba454b1cdae","Type":"ContainerDied","Data":"f7b8dc3ca8fc10aa78b83ecaeab5f69405030921a1141839fa538346a59625da"}
Jul 17 14:57:15.881383 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:15.881353    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh" event={"ID":"edc1644f-752b-40e1-856e-8ba454b1cdae","Type":"ContainerStarted","Data":"d7ede9a8b751d89b9c523dff579100e6b7efe51ec48fd30bc109905c4b9ca144"}
Jul 17 14:57:15.881753 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:15.881458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:15.906551 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:15.906505    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh" podStartSLOduration=2.725759397 podStartE2EDuration="6.90649339s" totalImagesPullingTime="3.142326785s" totalInitContainerRuntime="1.038407208s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:57:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:57:15.905356575 +0000 UTC m=+449.103620913" watchObservedRunningTime="2026-07-17 14:57:15.90649339 +0000 UTC m=+449.104757728"
Jul 17 14:57:20.752911 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:20.752873    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:21.137071 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:21.136975    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:25.785957 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:25.785928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:25.887704 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:25.887668    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:26.887918 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:26.887893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dcf5668f8-kcbvh"
Jul 17 14:57:27.712959 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.712917    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"]
Jul 17 14:57:27.724253 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.724224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.728007 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.727985    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 14:57:27.728154 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.728093    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 14:57:27.728154 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.727985    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 14:57:27.728293 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.728117    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x22dr\""
Jul 17 14:57:27.736432 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.736410    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"]
Jul 17 14:57:27.875902 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.875870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e9bb061-1db1-4f59-9145-596b7cfe291c-metrics-cert\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.876099 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.875924    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7e9bb061-1db1-4f59-9145-596b7cfe291c-manager-config\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.876099 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.875945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvjjv\" (UniqueName: \"kubernetes.io/projected/7e9bb061-1db1-4f59-9145-596b7cfe291c-kube-api-access-mvjjv\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.876099 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.876072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e9bb061-1db1-4f59-9145-596b7cfe291c-cert\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.977342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.977273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e9bb061-1db1-4f59-9145-596b7cfe291c-cert\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.977342 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.977302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e9bb061-1db1-4f59-9145-596b7cfe291c-metrics-cert\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.977826 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.977350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7e9bb061-1db1-4f59-9145-596b7cfe291c-manager-config\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.977826 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.977373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvjjv\" (UniqueName: \"kubernetes.io/projected/7e9bb061-1db1-4f59-9145-596b7cfe291c-kube-api-access-mvjjv\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.978136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.978115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7e9bb061-1db1-4f59-9145-596b7cfe291c-manager-config\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.980128 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.980101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7e9bb061-1db1-4f59-9145-596b7cfe291c-metrics-cert\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.980247 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.980186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e9bb061-1db1-4f59-9145-596b7cfe291c-cert\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:27.992213 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:27.992186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvjjv\" (UniqueName: \"kubernetes.io/projected/7e9bb061-1db1-4f59-9145-596b7cfe291c-kube-api-access-mvjjv\") pod \"lws-controller-manager-9db68d568-nf4x7\" (UID: \"7e9bb061-1db1-4f59-9145-596b7cfe291c\") " pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:28.034151 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:28.034119    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:28.176389 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:28.176347    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"]
Jul 17 14:57:28.178614 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:57:28.178589    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9bb061_1db1_4f59_9145_596b7cfe291c.slice/crio-a948aa1e580a0d06a01be1ba2a9fcc5b93c2a1fbc4db1e3ffe560e98535e298b WatchSource:0}: Error finding container a948aa1e580a0d06a01be1ba2a9fcc5b93c2a1fbc4db1e3ffe560e98535e298b: Status 404 returned error can't find the container with id a948aa1e580a0d06a01be1ba2a9fcc5b93c2a1fbc4db1e3ffe560e98535e298b
Jul 17 14:57:28.944080 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:28.944026    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7" event={"ID":"7e9bb061-1db1-4f59-9145-596b7cfe291c","Type":"ContainerStarted","Data":"a948aa1e580a0d06a01be1ba2a9fcc5b93c2a1fbc4db1e3ffe560e98535e298b"}
Jul 17 14:57:29.405524 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:29.405471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:29.911387 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:29.911345    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:30.023884 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:30.023828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:30.114010 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:30.113929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:30.824591 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:30.824561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:30.921456 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:30.921412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:30.955418 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:30.955392    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7" event={"ID":"7e9bb061-1db1-4f59-9145-596b7cfe291c","Type":"ContainerStarted","Data":"e9f05928444eb549857fe4ccc7808b15578637a343bb0a9e3651d4c9aed92434"}
Jul 17 14:57:30.955549 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:30.955450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:30.982587 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:30.982539    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7" podStartSLOduration=1.8431353050000001 podStartE2EDuration="3.982521755s" totalImagesPullingTime="2.13938645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:57:30.981226521 +0000 UTC m=+464.179490863" watchObservedRunningTime="2026-07-17 14:57:30.982521755 +0000 UTC m=+464.180786143"
Jul 17 14:57:31.015204 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:31.015172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:31.107812 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:31.107744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:31.199797 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:31.199769    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:31.823246 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:31.823194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:32.110573 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:32.110500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:32.219701 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:32.219655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:32.523417 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:32.523391    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:34.473616 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:34.473585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:39.390942 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.390913    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"]
Jul 17 14:57:39.394268 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.394249    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.399110 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.399088    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 14:57:39.399234 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.399170    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 14:57:39.399234 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.399229    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 14:57:39.399367 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.399346    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7ck9x\""
Jul 17 14:57:39.399423 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.399380    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 14:57:39.399620 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.399605    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 14:57:39.400281 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.400254    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 14:57:39.415270 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.415245    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"]
Jul 17 14:57:39.467774 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.467748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.467884 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.467775    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.467884 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.467808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.467884 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.467829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.467884 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.467871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5rlx\" (UniqueName: \"kubernetes.io/projected/2cfad67b-d668-4b48-81b1-2aeae605e7d1-kube-api-access-q5rlx\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.468020 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.467937    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.468020 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.467978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cfad67b-d668-4b48-81b1-2aeae605e7d1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.569163 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.569134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.569163 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.569166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.569398 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.569188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.569398 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.569203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.569398 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.569223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5rlx\" (UniqueName: \"kubernetes.io/projected/2cfad67b-d668-4b48-81b1-2aeae605e7d1-kube-api-access-q5rlx\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.569398 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.569269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.569398 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.569319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cfad67b-d668-4b48-81b1-2aeae605e7d1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.570217 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.570191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.572117 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.572093    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cfad67b-d668-4b48-81b1-2aeae605e7d1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.572380 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.572355    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.572794 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.572766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.572908 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.572887    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.581368 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.581332    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5rlx\" (UniqueName: \"kubernetes.io/projected/2cfad67b-d668-4b48-81b1-2aeae605e7d1-kube-api-access-q5rlx\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.581759 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.581735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cfad67b-d668-4b48-81b1-2aeae605e7d1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nnctx\" (UID: \"2cfad67b-d668-4b48-81b1-2aeae605e7d1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.704666 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.704583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:39.858592 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.858561    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"]
Jul 17 14:57:39.859885 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:57:39.859855    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfad67b_d668_4b48_81b1_2aeae605e7d1.slice/crio-a97806418c776f12043650638e1aead83802fb984a679652505c98e092ef828c WatchSource:0}: Error finding container a97806418c776f12043650638e1aead83802fb984a679652505c98e092ef828c: Status 404 returned error can't find the container with id a97806418c776f12043650638e1aead83802fb984a679652505c98e092ef828c
Jul 17 14:57:39.997954 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:39.997885    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx" event={"ID":"2cfad67b-d668-4b48-81b1-2aeae605e7d1","Type":"ContainerStarted","Data":"a97806418c776f12043650638e1aead83802fb984a679652505c98e092ef828c"}
Jul 17 14:57:41.962766 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:41.962738    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9db68d568-nf4x7"
Jul 17 14:57:42.494758 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:42.494725    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 14:57:42.494888 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:42.494790    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 14:57:42.629775 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:42.629749    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:42.799881 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:42.799804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:42.989464 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:42.989435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:43.016453 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.016415    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx" event={"ID":"2cfad67b-d668-4b48-81b1-2aeae605e7d1","Type":"ContainerStarted","Data":"00b1e0ada88035a9b90cf57837febc88fced34b2622c93d840a338ad6a95af53"}
Jul 17 14:57:43.016754 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.016722    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:43.018268 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.018245    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-nnctx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 14:57:43.018390 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.018292    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx" podUID="2cfad67b-d668-4b48-81b1-2aeae605e7d1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 14:57:43.123510 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.123434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:43.212461 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.212421    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:43.308586 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.308558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:43.704159 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.704120    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:43.784664 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:43.784638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:44.021326 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:44.021248    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-nnctx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 14:57:44.021326 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:44.021318    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx" podUID="2cfad67b-d668-4b48-81b1-2aeae605e7d1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 14:57:45.386240 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:45.386194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:45.759992 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:45.759910    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:45.856312 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:45.856281    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:46.229699 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:46.229666    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:46.325838 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:46.325805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:46.453016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:46.452975    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:57:47.022123 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:47.022095    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx"
Jul 17 14:57:47.065196 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:57:47.065150    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nnctx" podStartSLOduration=5.432535118 podStartE2EDuration="8.06513648s" totalImagesPullingTime="2.632601362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:57:43.109780954 +0000 UTC m=+476.308045293" watchObservedRunningTime="2026-07-17 14:57:47.06513648 +0000 UTC m=+480.263400817"
Jul 17 14:58:00.444937 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:00.444904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:07.773795 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:07.773759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:07.874855 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:07.874823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:31.035003 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:31.034974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:31.151561 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:31.151534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:31.356980 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:31.356912    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:31.994980 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:31.994951    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:32.194745 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:32.194716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:39.612163 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:39.612089    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:39.715022 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:39.714992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:41.466274 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:41.466241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:41.540998 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:41.540974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:58:43.434477 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.434449    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"]
Jul 17 14:58:43.437867 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.437853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.440450 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.440425    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 14:58:43.440450 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.440442    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 14:58:43.440648 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.440483    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-brc6n\""
Jul 17 14:58:43.447579 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.447557    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"]
Jul 17 14:58:43.483013 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.482989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcs7n\" (UniqueName: \"kubernetes.io/projected/18a87401-b531-47bf-a6c6-c427b10637e1-kube-api-access-fcs7n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.483151 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.483075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.483151 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.483120    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.584016 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.583992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.584133 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.584056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.584133 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.584078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcs7n\" (UniqueName: \"kubernetes.io/projected/18a87401-b531-47bf-a6c6-c427b10637e1-kube-api-access-fcs7n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.584353 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.584336    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.584395 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.584361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.597132 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.597108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcs7n\" (UniqueName: \"kubernetes.io/projected/18a87401-b531-47bf-a6c6-c427b10637e1-kube-api-access-fcs7n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.747690 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.747617    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:43.882380 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:43.882358    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"]
Jul 17 14:58:43.884487 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:58:43.884460    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a87401_b531_47bf_a6c6_c427b10637e1.slice/crio-e99b1c1ae4493eeafe7d33c02ce9f64460d4d297daa9a17e35a8d3479561844c WatchSource:0}: Error finding container e99b1c1ae4493eeafe7d33c02ce9f64460d4d297daa9a17e35a8d3479561844c: Status 404 returned error can't find the container with id e99b1c1ae4493eeafe7d33c02ce9f64460d4d297daa9a17e35a8d3479561844c
Jul 17 14:58:44.014959 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.014899    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"]
Jul 17 14:58:44.018226 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.018211    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.030089 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.030065    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"]
Jul 17 14:58:44.086892 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.086866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.087009 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.086912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.087009 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.086936    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dmv8\" (UniqueName: \"kubernetes.io/projected/cb616fc8-ab5f-41da-bd99-b716d83de0f8-kube-api-access-6dmv8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.187614 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.187588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dmv8\" (UniqueName: \"kubernetes.io/projected/cb616fc8-ab5f-41da-bd99-b716d83de0f8-kube-api-access-6dmv8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.187726 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.187646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.187726 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.187684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.187981 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.187968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.188024 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.188002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.198118 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.198096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dmv8\" (UniqueName: \"kubernetes.io/projected/cb616fc8-ab5f-41da-bd99-b716d83de0f8-kube-api-access-6dmv8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.287775 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.287718    2561 generic.go:356] "Generic (PLEG): container finished" podID="18a87401-b531-47bf-a6c6-c427b10637e1" containerID="8a7d1d7e438dea1f0215afd95ba555a12b1fb279c2115ba3b51349b775d77f4e" exitCode=0
Jul 17 14:58:44.287775 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.287765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz" event={"ID":"18a87401-b531-47bf-a6c6-c427b10637e1","Type":"ContainerDied","Data":"8a7d1d7e438dea1f0215afd95ba555a12b1fb279c2115ba3b51349b775d77f4e"}
Jul 17 14:58:44.287895 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.287798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz" event={"ID":"18a87401-b531-47bf-a6c6-c427b10637e1","Type":"ContainerStarted","Data":"e99b1c1ae4493eeafe7d33c02ce9f64460d4d297daa9a17e35a8d3479561844c"}
Jul 17 14:58:44.339315 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.339292    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:44.471367 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.471345    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"]
Jul 17 14:58:44.473495 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:58:44.473471    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb616fc8_ab5f_41da_bd99_b716d83de0f8.slice/crio-59788050ccfe9b1fdabaa706b6203fffc86c203b14c8c8de05dbed22495b3e89 WatchSource:0}: Error finding container 59788050ccfe9b1fdabaa706b6203fffc86c203b14c8c8de05dbed22495b3e89: Status 404 returned error can't find the container with id 59788050ccfe9b1fdabaa706b6203fffc86c203b14c8c8de05dbed22495b3e89
Jul 17 14:58:44.617563 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.617526    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"]
Jul 17 14:58:44.620923 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.620903    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.631136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.631113    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"]
Jul 17 14:58:44.692373 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.692351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.692476 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.692408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rplms\" (UniqueName: \"kubernetes.io/projected/f13333ff-6c80-4fd4-bddf-e128a165a4c2-kube-api-access-rplms\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.692516 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.692484    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.793211 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.793186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rplms\" (UniqueName: \"kubernetes.io/projected/f13333ff-6c80-4fd4-bddf-e128a165a4c2-kube-api-access-rplms\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.793304 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.793216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.793304 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.793278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.793604 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.793585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.793641 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.793621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.803398 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.803374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rplms\" (UniqueName: \"kubernetes.io/projected/f13333ff-6c80-4fd4-bddf-e128a165a4c2-kube-api-access-rplms\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:44.955079 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:44.955031    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:45.147840 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.147810    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"]
Jul 17 14:58:45.149184 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:58:45.149160    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13333ff_6c80_4fd4_bddf_e128a165a4c2.slice/crio-15cf5acf3f8b741da02fa6581dd4eeb57bb8e0020259a9faf942c9eba26a44c3 WatchSource:0}: Error finding container 15cf5acf3f8b741da02fa6581dd4eeb57bb8e0020259a9faf942c9eba26a44c3: Status 404 returned error can't find the container with id 15cf5acf3f8b741da02fa6581dd4eeb57bb8e0020259a9faf942c9eba26a44c3
Jul 17 14:58:45.232607 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.232585    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"]
Jul 17 14:58:45.235864 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.235850    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.244792 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.244769    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"]
Jul 17 14:58:45.294731 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.294706    2561 generic.go:356] "Generic (PLEG): container finished" podID="18a87401-b531-47bf-a6c6-c427b10637e1" containerID="eb01d66f0abca148fc24458b8fee63cd3ca4ddbe83f36c3d0cca9ce4b6d44b28" exitCode=0
Jul 17 14:58:45.294828 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.294777    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz" event={"ID":"18a87401-b531-47bf-a6c6-c427b10637e1","Type":"ContainerDied","Data":"eb01d66f0abca148fc24458b8fee63cd3ca4ddbe83f36c3d0cca9ce4b6d44b28"}
Jul 17 14:58:45.296344 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.296325    2561 generic.go:356] "Generic (PLEG): container finished" podID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerID="e9b1ad59b858adf6dd3d4bd64fa2ea32562bc88f1fb4058ad78aeea6c721113f" exitCode=0
Jul 17 14:58:45.296449 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.296347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn" event={"ID":"f13333ff-6c80-4fd4-bddf-e128a165a4c2","Type":"ContainerDied","Data":"e9b1ad59b858adf6dd3d4bd64fa2ea32562bc88f1fb4058ad78aeea6c721113f"}
Jul 17 14:58:45.296449 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.296390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn" event={"ID":"f13333ff-6c80-4fd4-bddf-e128a165a4c2","Type":"ContainerStarted","Data":"15cf5acf3f8b741da02fa6581dd4eeb57bb8e0020259a9faf942c9eba26a44c3"}
Jul 17 14:58:45.297401 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.297381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhq5q\" (UniqueName: \"kubernetes.io/projected/29b49be0-9017-4cd3-a570-edc34a822ac7-kube-api-access-dhq5q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.297501 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.297481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.297615 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.297588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.298222 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.298201    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerID="ae9039df099641981069c61c3c149a119f95e2215c69e626e02848476915207c" exitCode=0
Jul 17 14:58:45.298304 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.298247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb" event={"ID":"cb616fc8-ab5f-41da-bd99-b716d83de0f8","Type":"ContainerDied","Data":"ae9039df099641981069c61c3c149a119f95e2215c69e626e02848476915207c"}
Jul 17 14:58:45.298304 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.298281    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb" event={"ID":"cb616fc8-ab5f-41da-bd99-b716d83de0f8","Type":"ContainerStarted","Data":"59788050ccfe9b1fdabaa706b6203fffc86c203b14c8c8de05dbed22495b3e89"}
Jul 17 14:58:45.399024 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.398993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.399220 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.399054    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.399220 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.399106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhq5q\" (UniqueName: \"kubernetes.io/projected/29b49be0-9017-4cd3-a570-edc34a822ac7-kube-api-access-dhq5q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.399422 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.399401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.399482 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.399466    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.409949 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.409922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhq5q\" (UniqueName: \"kubernetes.io/projected/29b49be0-9017-4cd3-a570-edc34a822ac7-kube-api-access-dhq5q\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.547502 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.547445    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:45.685734 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:45.685702    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"]
Jul 17 14:58:45.688563 ip-10-0-143-54 kubenswrapper[2561]: W0717 14:58:45.688534    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b49be0_9017_4cd3_a570_edc34a822ac7.slice/crio-4798da3fa49ad64ac13ef51168e0726a668eb92c1188d92e9bd90f03cbf2b5b8 WatchSource:0}: Error finding container 4798da3fa49ad64ac13ef51168e0726a668eb92c1188d92e9bd90f03cbf2b5b8: Status 404 returned error can't find the container with id 4798da3fa49ad64ac13ef51168e0726a668eb92c1188d92e9bd90f03cbf2b5b8
Jul 17 14:58:46.305347 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:46.305317    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerID="e02ee614c302c1ca4e1c40ec9ae679c53ca3c31a97e562676c7546552f2e3eb0" exitCode=0
Jul 17 14:58:46.305459 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:46.305413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb" event={"ID":"cb616fc8-ab5f-41da-bd99-b716d83de0f8","Type":"ContainerDied","Data":"e02ee614c302c1ca4e1c40ec9ae679c53ca3c31a97e562676c7546552f2e3eb0"}
Jul 17 14:58:46.306994 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:46.306976    2561 generic.go:356] "Generic (PLEG): container finished" podID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerID="6dade841d7067e7713c3b56c9c7efd0282bdb2f85f68442741cc65c166792333" exitCode=0
Jul 17 14:58:46.307093 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:46.307066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5" event={"ID":"29b49be0-9017-4cd3-a570-edc34a822ac7","Type":"ContainerDied","Data":"6dade841d7067e7713c3b56c9c7efd0282bdb2f85f68442741cc65c166792333"}
Jul 17 14:58:46.307163 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:46.307123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5" event={"ID":"29b49be0-9017-4cd3-a570-edc34a822ac7","Type":"ContainerStarted","Data":"4798da3fa49ad64ac13ef51168e0726a668eb92c1188d92e9bd90f03cbf2b5b8"}
Jul 17 14:58:46.309644 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:46.309599    2561 generic.go:356] "Generic (PLEG): container finished" podID="18a87401-b531-47bf-a6c6-c427b10637e1" containerID="b97ea75062cf25d212621b0ca5c741039a746b49379518a2d23141b0a70ceb4c" exitCode=0
Jul 17 14:58:46.309741 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:46.309690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz" event={"ID":"18a87401-b531-47bf-a6c6-c427b10637e1","Type":"ContainerDied","Data":"b97ea75062cf25d212621b0ca5c741039a746b49379518a2d23141b0a70ceb4c"}
Jul 17 14:58:47.317399 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.317371    2561 generic.go:356] "Generic (PLEG): container finished" podID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerID="c441e1428527647d35903d425169b900d160afbb30e719e9c1fb9acc3c115807" exitCode=0
Jul 17 14:58:47.317837 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.317448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn" event={"ID":"f13333ff-6c80-4fd4-bddf-e128a165a4c2","Type":"ContainerDied","Data":"c441e1428527647d35903d425169b900d160afbb30e719e9c1fb9acc3c115807"}
Jul 17 14:58:47.319609 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.319586    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerID="f26dc05ea1f9417131d1dd1cfcaad28c0a17b40b537da6ff74eddf71a181b0a7" exitCode=0
Jul 17 14:58:47.319687 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.319656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb" event={"ID":"cb616fc8-ab5f-41da-bd99-b716d83de0f8","Type":"ContainerDied","Data":"f26dc05ea1f9417131d1dd1cfcaad28c0a17b40b537da6ff74eddf71a181b0a7"}
Jul 17 14:58:47.481218 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.481190    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:47.518014 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.517800    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcs7n\" (UniqueName: \"kubernetes.io/projected/18a87401-b531-47bf-a6c6-c427b10637e1-kube-api-access-fcs7n\") pod \"18a87401-b531-47bf-a6c6-c427b10637e1\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") "
Jul 17 14:58:47.518014 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.517863    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-util\") pod \"18a87401-b531-47bf-a6c6-c427b10637e1\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") "
Jul 17 14:58:47.518014 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.517965    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-bundle\") pod \"18a87401-b531-47bf-a6c6-c427b10637e1\" (UID: \"18a87401-b531-47bf-a6c6-c427b10637e1\") "
Jul 17 14:58:47.518897 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.518669    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-bundle" (OuterVolumeSpecName: "bundle") pod "18a87401-b531-47bf-a6c6-c427b10637e1" (UID: "18a87401-b531-47bf-a6c6-c427b10637e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:47.520812 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.520787    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a87401-b531-47bf-a6c6-c427b10637e1-kube-api-access-fcs7n" (OuterVolumeSpecName: "kube-api-access-fcs7n") pod "18a87401-b531-47bf-a6c6-c427b10637e1" (UID: "18a87401-b531-47bf-a6c6-c427b10637e1"). InnerVolumeSpecName "kube-api-access-fcs7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:58:47.523662 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.523639    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-util" (OuterVolumeSpecName: "util") pod "18a87401-b531-47bf-a6c6-c427b10637e1" (UID: "18a87401-b531-47bf-a6c6-c427b10637e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:47.618647 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.618623    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:47.618738 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.618649    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcs7n\" (UniqueName: \"kubernetes.io/projected/18a87401-b531-47bf-a6c6-c427b10637e1-kube-api-access-fcs7n\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:47.618738 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:47.618664    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18a87401-b531-47bf-a6c6-c427b10637e1-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:48.326371 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.326340    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz"
Jul 17 14:58:48.326775 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.326344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz" event={"ID":"18a87401-b531-47bf-a6c6-c427b10637e1","Type":"ContainerDied","Data":"e99b1c1ae4493eeafe7d33c02ce9f64460d4d297daa9a17e35a8d3479561844c"}
Jul 17 14:58:48.326775 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.326471    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e99b1c1ae4493eeafe7d33c02ce9f64460d4d297daa9a17e35a8d3479561844c"
Jul 17 14:58:48.328521 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.328488    2561 generic.go:356] "Generic (PLEG): container finished" podID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerID="5539d2e8c67038733b42fe1ae9854f94047965b6e6d3b6a0fa24f3470cb567ce" exitCode=0
Jul 17 14:58:48.328647 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.328577    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn" event={"ID":"f13333ff-6c80-4fd4-bddf-e128a165a4c2","Type":"ContainerDied","Data":"5539d2e8c67038733b42fe1ae9854f94047965b6e6d3b6a0fa24f3470cb567ce"}
Jul 17 14:58:48.330284 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.330262    2561 generic.go:356] "Generic (PLEG): container finished" podID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerID="5b979be01c2eafe993f4b0b9f6856099b9521a8ea963a808e17858ddf53bbbf9" exitCode=0
Jul 17 14:58:48.330396 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.330331    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5" event={"ID":"29b49be0-9017-4cd3-a570-edc34a822ac7","Type":"ContainerDied","Data":"5b979be01c2eafe993f4b0b9f6856099b9521a8ea963a808e17858ddf53bbbf9"}
Jul 17 14:58:48.455380 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.455346    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:48.526089 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.526062    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-util\") pod \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") "
Jul 17 14:58:48.526192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.526095    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dmv8\" (UniqueName: \"kubernetes.io/projected/cb616fc8-ab5f-41da-bd99-b716d83de0f8-kube-api-access-6dmv8\") pod \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") "
Jul 17 14:58:48.526192 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.526158    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-bundle\") pod \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\" (UID: \"cb616fc8-ab5f-41da-bd99-b716d83de0f8\") "
Jul 17 14:58:48.526703 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.526680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-bundle" (OuterVolumeSpecName: "bundle") pod "cb616fc8-ab5f-41da-bd99-b716d83de0f8" (UID: "cb616fc8-ab5f-41da-bd99-b716d83de0f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:48.528107 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.528088    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb616fc8-ab5f-41da-bd99-b716d83de0f8-kube-api-access-6dmv8" (OuterVolumeSpecName: "kube-api-access-6dmv8") pod "cb616fc8-ab5f-41da-bd99-b716d83de0f8" (UID: "cb616fc8-ab5f-41da-bd99-b716d83de0f8"). InnerVolumeSpecName "kube-api-access-6dmv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:58:48.531677 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.531654    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-util" (OuterVolumeSpecName: "util") pod "cb616fc8-ab5f-41da-bd99-b716d83de0f8" (UID: "cb616fc8-ab5f-41da-bd99-b716d83de0f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:48.627126 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.627066    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:48.627126 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.627099    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dmv8\" (UniqueName: \"kubernetes.io/projected/cb616fc8-ab5f-41da-bd99-b716d83de0f8-kube-api-access-6dmv8\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:48.627126 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:48.627108    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb616fc8-ab5f-41da-bd99-b716d83de0f8-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:49.337301 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.337271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb" event={"ID":"cb616fc8-ab5f-41da-bd99-b716d83de0f8","Type":"ContainerDied","Data":"59788050ccfe9b1fdabaa706b6203fffc86c203b14c8c8de05dbed22495b3e89"}
Jul 17 14:58:49.337658 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.337321    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59788050ccfe9b1fdabaa706b6203fffc86c203b14c8c8de05dbed22495b3e89"
Jul 17 14:58:49.337658 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.337281    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb"
Jul 17 14:58:49.339786 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.339761    2561 generic.go:356] "Generic (PLEG): container finished" podID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerID="f1f28c40c13d7b0e21f1d49739946393cd16042865ac62387ab39ebbf5230cab" exitCode=0
Jul 17 14:58:49.340010 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.339811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5" event={"ID":"29b49be0-9017-4cd3-a570-edc34a822ac7","Type":"ContainerDied","Data":"f1f28c40c13d7b0e21f1d49739946393cd16042865ac62387ab39ebbf5230cab"}
Jul 17 14:58:49.464790 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.464766    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:49.532857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.532793    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rplms\" (UniqueName: \"kubernetes.io/projected/f13333ff-6c80-4fd4-bddf-e128a165a4c2-kube-api-access-rplms\") pod \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") "
Jul 17 14:58:49.532857 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.532843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-util\") pod \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") "
Jul 17 14:58:49.533071 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.533034    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-bundle\") pod \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\" (UID: \"f13333ff-6c80-4fd4-bddf-e128a165a4c2\") "
Jul 17 14:58:49.533520 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.533487    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-bundle" (OuterVolumeSpecName: "bundle") pod "f13333ff-6c80-4fd4-bddf-e128a165a4c2" (UID: "f13333ff-6c80-4fd4-bddf-e128a165a4c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:49.535024 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.535002    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13333ff-6c80-4fd4-bddf-e128a165a4c2-kube-api-access-rplms" (OuterVolumeSpecName: "kube-api-access-rplms") pod "f13333ff-6c80-4fd4-bddf-e128a165a4c2" (UID: "f13333ff-6c80-4fd4-bddf-e128a165a4c2"). InnerVolumeSpecName "kube-api-access-rplms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:58:49.538255 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.538223    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-util" (OuterVolumeSpecName: "util") pod "f13333ff-6c80-4fd4-bddf-e128a165a4c2" (UID: "f13333ff-6c80-4fd4-bddf-e128a165a4c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:49.633687 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.633660    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:49.633687 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.633686    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rplms\" (UniqueName: \"kubernetes.io/projected/f13333ff-6c80-4fd4-bddf-e128a165a4c2-kube-api-access-rplms\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:49.633854 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:49.633696    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f13333ff-6c80-4fd4-bddf-e128a165a4c2-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:50.347362 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.347333    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn"
Jul 17 14:58:50.347746 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.347366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn" event={"ID":"f13333ff-6c80-4fd4-bddf-e128a165a4c2","Type":"ContainerDied","Data":"15cf5acf3f8b741da02fa6581dd4eeb57bb8e0020259a9faf942c9eba26a44c3"}
Jul 17 14:58:50.347746 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.347406    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15cf5acf3f8b741da02fa6581dd4eeb57bb8e0020259a9faf942c9eba26a44c3"
Jul 17 14:58:50.469136 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.469113    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:50.540481 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.540458    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhq5q\" (UniqueName: \"kubernetes.io/projected/29b49be0-9017-4cd3-a570-edc34a822ac7-kube-api-access-dhq5q\") pod \"29b49be0-9017-4cd3-a570-edc34a822ac7\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") "
Jul 17 14:58:50.540589 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.540548    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-util\") pod \"29b49be0-9017-4cd3-a570-edc34a822ac7\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") "
Jul 17 14:58:50.540589 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.540584    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-bundle\") pod \"29b49be0-9017-4cd3-a570-edc34a822ac7\" (UID: \"29b49be0-9017-4cd3-a570-edc34a822ac7\") "
Jul 17 14:58:50.541134 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.541106    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-bundle" (OuterVolumeSpecName: "bundle") pod "29b49be0-9017-4cd3-a570-edc34a822ac7" (UID: "29b49be0-9017-4cd3-a570-edc34a822ac7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:50.542520 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.542502    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29b49be0-9017-4cd3-a570-edc34a822ac7-kube-api-access-dhq5q" (OuterVolumeSpecName: "kube-api-access-dhq5q") pod "29b49be0-9017-4cd3-a570-edc34a822ac7" (UID: "29b49be0-9017-4cd3-a570-edc34a822ac7"). InnerVolumeSpecName "kube-api-access-dhq5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 14:58:50.545935 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.545905    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-util" (OuterVolumeSpecName: "util") pod "29b49be0-9017-4cd3-a570-edc34a822ac7" (UID: "29b49be0-9017-4cd3-a570-edc34a822ac7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 14:58:50.641379 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.641357    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-util\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:50.641379 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.641378    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29b49be0-9017-4cd3-a570-edc34a822ac7-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:50.641512 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:50.641387    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhq5q\" (UniqueName: \"kubernetes.io/projected/29b49be0-9017-4cd3-a570-edc34a822ac7-kube-api-access-dhq5q\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 14:58:51.353129 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:51.353097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5" event={"ID":"29b49be0-9017-4cd3-a570-edc34a822ac7","Type":"ContainerDied","Data":"4798da3fa49ad64ac13ef51168e0726a668eb92c1188d92e9bd90f03cbf2b5b8"}
Jul 17 14:58:51.353129 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:51.353128    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5"
Jul 17 14:58:51.353527 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:51.353143    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4798da3fa49ad64ac13ef51168e0726a668eb92c1188d92e9bd90f03cbf2b5b8"
Jul 17 14:58:57.498810 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:58:57.498779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:01.706532 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:01.706494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:04.517122 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:04.517090    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:04.671967 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:04.671925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:06.332201 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:06.332169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:10.684395 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:10.684366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:11.266654 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:11.266602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:16.486106 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:16.486073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:16.586206 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:16.586172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:18.942665 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:18.942619    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:19.201388 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:19.201288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:23.467808 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:23.467776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:23.572609 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:23.572569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:27.530240 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:27.530199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:33.499368 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:33.499326    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:33.601944 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:33.601897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:34.918381 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:34.918351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:35.023627 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:35.023598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:35.710568 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:35.710537    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:35.806561 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:35.806535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:37.360467 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:37.360436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:41.267882 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:41.267842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:41.337646 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:41.337619    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:42.753582 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:42.753533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:42.832782 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:42.832702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:44.897982 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:44.897952    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:44.988247 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:44.988204    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:47.145137 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:47.145105    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 14:59:47.147532 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:47.147515    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 14:59:48.482594 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:48.482553    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:48.587318 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:48.587270    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:56.620025 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:56.619988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:56.728023 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:56.727975    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:59.113841 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:59.113810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 14:59:59.237385 ip-10-0-143-54 kubenswrapper[2561]: I0717 14:59:59.237360    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:02.554998 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:02.554967    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:02.635265 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:02.635232    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:05.931343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:05.931298    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:08.462516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:08.462418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:10.309555 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:10.309493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:10.451843 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:10.451803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:11.044384 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:11.044343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:11.118960 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:11.118932    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:12.775632 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.775599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:12.776484 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776465    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p872j"]
Jul 17 15:00:12.776796 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776783    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerName="pull"
Jul 17 15:00:12.776843 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776798    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerName="pull"
Jul 17 15:00:12.776843 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776811    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerName="extract"
Jul 17 15:00:12.776843 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776818    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerName="extract"
Jul 17 15:00:12.776843 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776829    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerName="pull"
Jul 17 15:00:12.776843 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776835    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerName="pull"
Jul 17 15:00:12.776843 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776842    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776847    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776853    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerName="pull"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776859    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerName="pull"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776869    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a87401-b531-47bf-a6c6-c427b10637e1" containerName="pull"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776875    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a87401-b531-47bf-a6c6-c427b10637e1" containerName="pull"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776881    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776885    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776896    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776904    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776915    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a87401-b531-47bf-a6c6-c427b10637e1" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776920    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a87401-b531-47bf-a6c6-c427b10637e1" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776926    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a87401-b531-47bf-a6c6-c427b10637e1" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776931    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a87401-b531-47bf-a6c6-c427b10637e1" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776937    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776941    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerName="util"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776948    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.776952    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.777017    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a87401-b531-47bf-a6c6-c427b10637e1" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.777027    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b49be0-9017-4cd3-a570-edc34a822ac7" containerName="extract"
Jul 17 15:00:12.777031 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.777034    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13333ff-6c80-4fd4-bddf-e128a165a4c2" containerName="extract"
Jul 17 15:00:12.777629 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.777056    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb616fc8-ab5f-41da-bd99-b716d83de0f8" containerName="extract"
Jul 17 15:00:12.779891 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.779877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:12.782881 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.782861    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 15:00:12.783009 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.782863    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 15:00:12.783631 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.783613    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 15:00:12.783725 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.783621    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-brc6n\""
Jul 17 15:00:12.795301 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.795278    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p872j"]
Jul 17 15:00:12.869847 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.869819    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p872j"]
Jul 17 15:00:12.876138 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.876109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7df951c-3aff-404c-9e8a-2e227731a28d-config-file\") pod \"limitador-limitador-64c94fd64f-p872j\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:12.876267 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.876157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n64m\" (UniqueName: \"kubernetes.io/projected/f7df951c-3aff-404c-9e8a-2e227731a28d-kube-api-access-5n64m\") pod \"limitador-limitador-64c94fd64f-p872j\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:12.890154 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.890131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:12.956469 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.956448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:12.976851 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.976820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7df951c-3aff-404c-9e8a-2e227731a28d-config-file\") pod \"limitador-limitador-64c94fd64f-p872j\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:12.976932 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.976861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n64m\" (UniqueName: \"kubernetes.io/projected/f7df951c-3aff-404c-9e8a-2e227731a28d-kube-api-access-5n64m\") pod \"limitador-limitador-64c94fd64f-p872j\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:12.977410 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.977395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7df951c-3aff-404c-9e8a-2e227731a28d-config-file\") pod \"limitador-limitador-64c94fd64f-p872j\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:12.987010 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:12.986987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n64m\" (UniqueName: \"kubernetes.io/projected/f7df951c-3aff-404c-9e8a-2e227731a28d-kube-api-access-5n64m\") pod \"limitador-limitador-64c94fd64f-p872j\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:13.090490 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:13.090432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:13.225501 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:13.225474    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p872j"]
Jul 17 15:00:13.227438 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:00:13.227409    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7df951c_3aff_404c_9e8a_2e227731a28d.slice/crio-7253a664e19b1702216122f29ee0f40742664398567319890db6293f4ac3bccb WatchSource:0}: Error finding container 7253a664e19b1702216122f29ee0f40742664398567319890db6293f4ac3bccb: Status 404 returned error can't find the container with id 7253a664e19b1702216122f29ee0f40742664398567319890db6293f4ac3bccb
Jul 17 15:00:13.716848 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:13.716817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:13.753874 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:13.753851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j" event={"ID":"f7df951c-3aff-404c-9e8a-2e227731a28d","Type":"ContainerStarted","Data":"7253a664e19b1702216122f29ee0f40742664398567319890db6293f4ac3bccb"}
Jul 17 15:00:13.791735 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:13.791708    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:14.658665 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:14.658632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:14.751421 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:14.751390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:15.023278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:15.023183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:16.773500 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:16.773468    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j" event={"ID":"f7df951c-3aff-404c-9e8a-2e227731a28d","Type":"ContainerStarted","Data":"ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2"}
Jul 17 15:00:16.773856 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:16.773580    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:16.794394 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:16.794335    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j" podStartSLOduration=2.051148347 podStartE2EDuration="4.794317721s" totalImagesPullingTime="2.743169374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:00:16.794127178 +0000 UTC m=+629.992391518" watchObservedRunningTime="2026-07-17 15:00:16.794317721 +0000 UTC m=+629.992582061"
Jul 17 15:00:27.684222 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:27.684187    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p872j"]
Jul 17 15:00:27.684613 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:27.684360    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j" podUID="f7df951c-3aff-404c-9e8a-2e227731a28d" containerName="limitador" containerID="cri-o://ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2" gracePeriod=30
Jul 17 15:00:27.685070 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:27.685018    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:28.226939 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.226911    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:28.297197 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.297139    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7df951c-3aff-404c-9e8a-2e227731a28d-config-file\") pod \"f7df951c-3aff-404c-9e8a-2e227731a28d\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") "
Jul 17 15:00:28.297197 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.297184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n64m\" (UniqueName: \"kubernetes.io/projected/f7df951c-3aff-404c-9e8a-2e227731a28d-kube-api-access-5n64m\") pod \"f7df951c-3aff-404c-9e8a-2e227731a28d\" (UID: \"f7df951c-3aff-404c-9e8a-2e227731a28d\") "
Jul 17 15:00:28.297483 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.297461    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7df951c-3aff-404c-9e8a-2e227731a28d-config-file" (OuterVolumeSpecName: "config-file") pod "f7df951c-3aff-404c-9e8a-2e227731a28d" (UID: "f7df951c-3aff-404c-9e8a-2e227731a28d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:00:28.299316 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.299294    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7df951c-3aff-404c-9e8a-2e227731a28d-kube-api-access-5n64m" (OuterVolumeSpecName: "kube-api-access-5n64m") pod "f7df951c-3aff-404c-9e8a-2e227731a28d" (UID: "f7df951c-3aff-404c-9e8a-2e227731a28d"). InnerVolumeSpecName "kube-api-access-5n64m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:00:28.398106 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.398086    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7df951c-3aff-404c-9e8a-2e227731a28d-config-file\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:00:28.398106 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.398108    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n64m\" (UniqueName: \"kubernetes.io/projected/f7df951c-3aff-404c-9e8a-2e227731a28d-kube-api-access-5n64m\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:00:28.832836 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.832805    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7df951c-3aff-404c-9e8a-2e227731a28d" containerID="ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2" exitCode=0
Jul 17 15:00:28.833290 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.832850    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j"
Jul 17 15:00:28.833290 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.832888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j" event={"ID":"f7df951c-3aff-404c-9e8a-2e227731a28d","Type":"ContainerDied","Data":"ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2"}
Jul 17 15:00:28.833290 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.832937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-p872j" event={"ID":"f7df951c-3aff-404c-9e8a-2e227731a28d","Type":"ContainerDied","Data":"7253a664e19b1702216122f29ee0f40742664398567319890db6293f4ac3bccb"}
Jul 17 15:00:28.833290 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.832961    2561 scope.go:117] "RemoveContainer" containerID="ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2"
Jul 17 15:00:28.842348 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.842332    2561 scope.go:117] "RemoveContainer" containerID="ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2"
Jul 17 15:00:28.842634 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:00:28.842616    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2\": container with ID starting with ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2 not found: ID does not exist" containerID="ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2"
Jul 17 15:00:28.842685 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.842643    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2"} err="failed to get container status \"ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2\": rpc error: code = NotFound desc = could not find container \"ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2\": container with ID starting with ce4b42562fb90eb63e35990d69cf36f392c95a196fc508e19bae17c38f6fade2 not found: ID does not exist"
Jul 17 15:00:28.866690 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.866664    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p872j"]
Jul 17 15:00:28.871695 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.871676    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-p872j"]
Jul 17 15:00:28.891364 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.891338    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:28.987486 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:28.987443    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:29.232105 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.232079    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7df951c-3aff-404c-9e8a-2e227731a28d" path="/var/lib/kubelet/pods/f7df951c-3aff-404c-9e8a-2e227731a28d/volumes"
Jul 17 15:00:29.348248 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.348220    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"]
Jul 17 15:00:29.348527 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.348514    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7df951c-3aff-404c-9e8a-2e227731a28d" containerName="limitador"
Jul 17 15:00:29.348591 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.348527    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7df951c-3aff-404c-9e8a-2e227731a28d" containerName="limitador"
Jul 17 15:00:29.348645 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.348595    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7df951c-3aff-404c-9e8a-2e227731a28d" containerName="limitador"
Jul 17 15:00:29.352849 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.352828    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.355719 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.355694    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-h5zkk\""
Jul 17 15:00:29.355835 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.355758    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 15:00:29.355835 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.355761    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 15:00:29.356670 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.356653    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:00:29.363815 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.363790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"]
Jul 17 15:00:29.385935 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.385903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:29.507454 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.507377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c7c33764-178f-475b-93b2-36816d4eeda6-data\") pod \"postgres-69fb4594cf-45tx5\" (UID: \"c7c33764-178f-475b-93b2-36816d4eeda6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.507454 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.507417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5ctw\" (UniqueName: \"kubernetes.io/projected/c7c33764-178f-475b-93b2-36816d4eeda6-kube-api-access-j5ctw\") pod \"postgres-69fb4594cf-45tx5\" (UID: \"c7c33764-178f-475b-93b2-36816d4eeda6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.608035 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.607995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c7c33764-178f-475b-93b2-36816d4eeda6-data\") pod \"postgres-69fb4594cf-45tx5\" (UID: \"c7c33764-178f-475b-93b2-36816d4eeda6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.608035 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.608034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5ctw\" (UniqueName: \"kubernetes.io/projected/c7c33764-178f-475b-93b2-36816d4eeda6-kube-api-access-j5ctw\") pod \"postgres-69fb4594cf-45tx5\" (UID: \"c7c33764-178f-475b-93b2-36816d4eeda6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.608340 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.608323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c7c33764-178f-475b-93b2-36816d4eeda6-data\") pod \"postgres-69fb4594cf-45tx5\" (UID: \"c7c33764-178f-475b-93b2-36816d4eeda6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.622548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.622526    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5ctw\" (UniqueName: \"kubernetes.io/projected/c7c33764-178f-475b-93b2-36816d4eeda6-kube-api-access-j5ctw\") pod \"postgres-69fb4594cf-45tx5\" (UID: \"c7c33764-178f-475b-93b2-36816d4eeda6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.663801 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.663781    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:29.805062 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.805023    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"]
Jul 17 15:00:29.807124 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:00:29.807091    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c33764_178f_475b_93b2_36816d4eeda6.slice/crio-049d63423ca0d2c22a388f2ab683a952c8fe3e85edacf0bb72fc6c492f0d3b98 WatchSource:0}: Error finding container 049d63423ca0d2c22a388f2ab683a952c8fe3e85edacf0bb72fc6c492f0d3b98: Status 404 returned error can't find the container with id 049d63423ca0d2c22a388f2ab683a952c8fe3e85edacf0bb72fc6c492f0d3b98
Jul 17 15:00:29.839580 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:29.839547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5" event={"ID":"c7c33764-178f-475b-93b2-36816d4eeda6","Type":"ContainerStarted","Data":"049d63423ca0d2c22a388f2ab683a952c8fe3e85edacf0bb72fc6c492f0d3b98"}
Jul 17 15:00:34.870868 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:34.870796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5" event={"ID":"c7c33764-178f-475b-93b2-36816d4eeda6","Type":"ContainerStarted","Data":"d7a189202bf59b9b84ed6f7f3c929fc3a799a31b5465e8889e7d4ee602aa96a8"}
Jul 17 15:00:34.871252 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:34.870911    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:34.909759 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:34.909699    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5" podStartSLOduration=1.106302092 podStartE2EDuration="5.909679844s" totalImagesPullingTime="4.803377752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:00:34.907435242 +0000 UTC m=+648.105699594" watchObservedRunningTime="2026-07-17 15:00:34.909679844 +0000 UTC m=+648.107944188"
Jul 17 15:00:40.906394 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:40.906368    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-45tx5"
Jul 17 15:00:41.273652 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:41.273574    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:41.743996 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:41.743967    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:48.704461 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.704430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:48.755416 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.755390    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cc78794b7-kd82r"]
Jul 17 15:00:48.778755 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.778731    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc78794b7-kd82r"]
Jul 17 15:00:48.778903 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.778835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:48.782070 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.782033    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 15:00:48.782222 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.782054    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 15:00:48.782314 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.782299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-52nt7\""
Jul 17 15:00:48.867325 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.867292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-webhook-cert\") pod \"maas-controller-6cc78794b7-kd82r\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") " pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:48.867511 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.867332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtv6\" (UniqueName: \"kubernetes.io/projected/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-kube-api-access-nhtv6\") pod \"maas-controller-6cc78794b7-kd82r\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") " pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:48.934251 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.934224    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-hsn5s"]
Jul 17 15:00:48.938170 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.938152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:48.949235 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.949208    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-hsn5s"]
Jul 17 15:00:48.967945 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.967881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-webhook-cert\") pod \"maas-controller-6cc78794b7-kd82r\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") " pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:48.967945 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.967910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtv6\" (UniqueName: \"kubernetes.io/projected/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-kube-api-access-nhtv6\") pod \"maas-controller-6cc78794b7-kd82r\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") " pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:48.968139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.968068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsm2j\" (UniqueName: \"kubernetes.io/projected/292f29a1-6264-4b7d-95e3-5f044e998209-kube-api-access-zsm2j\") pod \"maas-controller-9db8d9bf9-hsn5s\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") " pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:48.968351 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.968299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/292f29a1-6264-4b7d-95e3-5f044e998209-webhook-cert\") pod \"maas-controller-9db8d9bf9-hsn5s\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") " pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:48.970590 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.970570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-webhook-cert\") pod \"maas-controller-6cc78794b7-kd82r\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") " pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:48.981346 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:48.981325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtv6\" (UniqueName: \"kubernetes.io/projected/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-kube-api-access-nhtv6\") pod \"maas-controller-6cc78794b7-kd82r\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") " pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:49.069766 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.069736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/292f29a1-6264-4b7d-95e3-5f044e998209-webhook-cert\") pod \"maas-controller-9db8d9bf9-hsn5s\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") " pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:49.069881 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.069787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsm2j\" (UniqueName: \"kubernetes.io/projected/292f29a1-6264-4b7d-95e3-5f044e998209-kube-api-access-zsm2j\") pod \"maas-controller-9db8d9bf9-hsn5s\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") " pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:49.072003 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.071985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/292f29a1-6264-4b7d-95e3-5f044e998209-webhook-cert\") pod \"maas-controller-9db8d9bf9-hsn5s\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") " pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:49.079794 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.079777    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsm2j\" (UniqueName: \"kubernetes.io/projected/292f29a1-6264-4b7d-95e3-5f044e998209-kube-api-access-zsm2j\") pod \"maas-controller-9db8d9bf9-hsn5s\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") " pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:49.089634 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.089615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:49.218673 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.218648    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cc78794b7-kd82r"]
Jul 17 15:00:49.220243 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:00:49.220221    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef12a9c3_ba69_4d06_925a_ae0d2be41fd8.slice/crio-b5346d179d73cc2aaf7ae077d12d12ba055fc5b749038a1ff0bdc61484202583 WatchSource:0}: Error finding container b5346d179d73cc2aaf7ae077d12d12ba055fc5b749038a1ff0bdc61484202583: Status 404 returned error can't find the container with id b5346d179d73cc2aaf7ae077d12d12ba055fc5b749038a1ff0bdc61484202583
Jul 17 15:00:49.249055 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.249025    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:49.380816 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.380782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-hsn5s"]
Jul 17 15:00:49.382941 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:00:49.382910    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292f29a1_6264_4b7d_95e3_5f044e998209.slice/crio-a45345e45036b0b5ed5ea612edba34c62c22c1cf623bd147d442f68febecbe46 WatchSource:0}: Error finding container a45345e45036b0b5ed5ea612edba34c62c22c1cf623bd147d442f68febecbe46: Status 404 returned error can't find the container with id a45345e45036b0b5ed5ea612edba34c62c22c1cf623bd147d442f68febecbe46
Jul 17 15:00:49.950155 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.950071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc78794b7-kd82r" event={"ID":"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8","Type":"ContainerStarted","Data":"b5346d179d73cc2aaf7ae077d12d12ba055fc5b749038a1ff0bdc61484202583"}
Jul 17 15:00:49.952741 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:49.952708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s" event={"ID":"292f29a1-6264-4b7d-95e3-5f044e998209","Type":"ContainerStarted","Data":"a45345e45036b0b5ed5ea612edba34c62c22c1cf623bd147d442f68febecbe46"}
Jul 17 15:00:50.514718 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:50.514544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:50.615469 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:50.615374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:52.183425 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:52.183390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:52.284511 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:52.284438    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:00:52.973749 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:52.973716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s" event={"ID":"292f29a1-6264-4b7d-95e3-5f044e998209","Type":"ContainerStarted","Data":"ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7"}
Jul 17 15:00:52.973943 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:52.973779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:00:52.975283 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:52.975261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc78794b7-kd82r" event={"ID":"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8","Type":"ContainerStarted","Data":"61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45"}
Jul 17 15:00:52.975404 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:52.975390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:00:52.996934 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:52.996893    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s" podStartSLOduration=2.380550792 podStartE2EDuration="4.996877192s" totalImagesPullingTime="2.6163264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:00:52.995310719 +0000 UTC m=+666.193575059" watchObservedRunningTime="2026-07-17 15:00:52.996877192 +0000 UTC m=+666.195141533"
Jul 17 15:00:53.015955 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:00:53.015914    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cc78794b7-kd82r" podStartSLOduration=2.225069033 podStartE2EDuration="5.015901414s" totalImagesPullingTime="2.790832381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:00:53.014527291 +0000 UTC m=+666.212791630" watchObservedRunningTime="2026-07-17 15:00:53.015901414 +0000 UTC m=+666.214165752"
Jul 17 15:01:03.983124 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:03.983093    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:01:03.983495 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:03.983166    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:01:04.061182 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.061149    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc78794b7-kd82r"]
Jul 17 15:01:04.061345 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.061327    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cc78794b7-kd82r" podUID="ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" containerName="manager" containerID="cri-o://61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45" gracePeriod=30
Jul 17 15:01:04.304579 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.304554    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:01:04.400160 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.400134    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-webhook-cert\") pod \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") "
Jul 17 15:01:04.400160 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.400164    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhtv6\" (UniqueName: \"kubernetes.io/projected/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-kube-api-access-nhtv6\") pod \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\" (UID: \"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8\") "
Jul 17 15:01:04.402326 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.402288    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" (UID: "ef12a9c3-ba69-4d06-925a-ae0d2be41fd8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:01:04.402437 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.402388    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-kube-api-access-nhtv6" (OuterVolumeSpecName: "kube-api-access-nhtv6") pod "ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" (UID: "ef12a9c3-ba69-4d06-925a-ae0d2be41fd8"). InnerVolumeSpecName "kube-api-access-nhtv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:01:04.500957 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.500925    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-webhook-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:01:04.500957 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:04.500953    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhtv6\" (UniqueName: \"kubernetes.io/projected/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8-kube-api-access-nhtv6\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:01:05.037054 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.037006    2561 generic.go:356] "Generic (PLEG): container finished" podID="ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" containerID="61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45" exitCode=0
Jul 17 15:01:05.037472 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.037067    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cc78794b7-kd82r"
Jul 17 15:01:05.037472 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.037072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc78794b7-kd82r" event={"ID":"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8","Type":"ContainerDied","Data":"61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45"}
Jul 17 15:01:05.037472 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.037114    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cc78794b7-kd82r" event={"ID":"ef12a9c3-ba69-4d06-925a-ae0d2be41fd8","Type":"ContainerDied","Data":"b5346d179d73cc2aaf7ae077d12d12ba055fc5b749038a1ff0bdc61484202583"}
Jul 17 15:01:05.037472 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.037135    2561 scope.go:117] "RemoveContainer" containerID="61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45"
Jul 17 15:01:05.046059 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.046026    2561 scope.go:117] "RemoveContainer" containerID="61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45"
Jul 17 15:01:05.046316 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:01:05.046298    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45\": container with ID starting with 61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45 not found: ID does not exist" containerID="61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45"
Jul 17 15:01:05.046390 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.046322    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45"} err="failed to get container status \"61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45\": rpc error: code = NotFound desc = could not find container \"61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45\": container with ID starting with 61a8e7641416e1cca6945d4330fb7c198af4f3e47c20939d3742e1130463bc45 not found: ID does not exist"
Jul 17 15:01:05.061074 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.061032    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cc78794b7-kd82r"]
Jul 17 15:01:05.067247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.067209    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cc78794b7-kd82r"]
Jul 17 15:01:05.232519 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:05.232489    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" path="/var/lib/kubelet/pods/ef12a9c3-ba69-4d06-925a-ae0d2be41fd8/volumes"
Jul 17 15:01:23.051486 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.051455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:01:23.666928 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.666895    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"]
Jul 17 15:01:23.667268 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.667253    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" containerName="manager"
Jul 17 15:01:23.667325 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.667271    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" containerName="manager"
Jul 17 15:01:23.667373 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.667363    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef12a9c3-ba69-4d06-925a-ae0d2be41fd8" containerName="manager"
Jul 17 15:01:23.675248 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.675227    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.678604 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.678585    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 15:01:23.678719 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.678587    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jlsxc\""
Jul 17 15:01:23.687057 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.687018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"]
Jul 17 15:01:23.751695 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.751667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c42513-faf7-4235-934e-d45362d296d4-maas-api-tls\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.751829 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.751710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c42513-faf7-4235-934e-d45362d296d4-openshift-service-ca\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.751829 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.751769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9vgm\" (UniqueName: \"kubernetes.io/projected/b0c42513-faf7-4235-934e-d45362d296d4-kube-api-access-d9vgm\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.852947 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.852919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c42513-faf7-4235-934e-d45362d296d4-openshift-service-ca\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.853110 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.852968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9vgm\" (UniqueName: \"kubernetes.io/projected/b0c42513-faf7-4235-934e-d45362d296d4-kube-api-access-d9vgm\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.853110 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.853074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c42513-faf7-4235-934e-d45362d296d4-maas-api-tls\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.853570 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.853549    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c42513-faf7-4235-934e-d45362d296d4-openshift-service-ca\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.855464 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.855447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c42513-faf7-4235-934e-d45362d296d4-maas-api-tls\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.862335 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.862313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9vgm\" (UniqueName: \"kubernetes.io/projected/b0c42513-faf7-4235-934e-d45362d296d4-kube-api-access-d9vgm\") pod \"maas-api-64bf799b45-pzcbw\" (UID: \"b0c42513-faf7-4235-934e-d45362d296d4\") " pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:23.986206 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:23.986143    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:24.127096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.127071    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"]
Jul 17 15:01:24.129138 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:01:24.129108    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c42513_faf7_4235_934e_d45362d296d4.slice/crio-447c1aaa047f5ed13b92837c7abbc65385bd47fdd7b3dd0bafc6c8a2a2d13ba8 WatchSource:0}: Error finding container 447c1aaa047f5ed13b92837c7abbc65385bd47fdd7b3dd0bafc6c8a2a2d13ba8: Status 404 returned error can't find the container with id 447c1aaa047f5ed13b92837c7abbc65385bd47fdd7b3dd0bafc6c8a2a2d13ba8
Jul 17 15:01:24.130539 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.130516    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:01:24.534858 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.534827    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-phxp8"]
Jul 17 15:01:24.538435 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.538419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.542532 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.542511    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5vjsn\""
Jul 17 15:01:24.543142 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.543126    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 15:01:24.552028 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.552003    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-phxp8"]
Jul 17 15:01:24.609827 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.609799    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-pttbc"]
Jul 17 15:01:24.612989 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.612971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.624552 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.624529    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-pttbc"]
Jul 17 15:01:24.661817 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.661778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cv8k\" (UniqueName: \"kubernetes.io/projected/3d00bdc0-a115-44e1-ae0c-f19613d67607-kube-api-access-8cv8k\") pod \"payload-processing-5bf47cd988-phxp8\" (UID: \"3d00bdc0-a115-44e1-ae0c-f19613d67607\") " pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.661954 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.661842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d00bdc0-a115-44e1-ae0c-f19613d67607-plugins-config-volume\") pod \"payload-processing-5bf47cd988-phxp8\" (UID: \"3d00bdc0-a115-44e1-ae0c-f19613d67607\") " pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.747915 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.747882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:01:24.763095 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.763072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgdlx\" (UniqueName: \"kubernetes.io/projected/7fe84b9f-0b0a-46bc-b10a-15671c6b6f87-kube-api-access-dgdlx\") pod \"payload-pre-processing-7677b774bb-pttbc\" (UID: \"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.763177 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.763105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fe84b9f-0b0a-46bc-b10a-15671c6b6f87-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-pttbc\" (UID: \"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.763177 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.763155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cv8k\" (UniqueName: \"kubernetes.io/projected/3d00bdc0-a115-44e1-ae0c-f19613d67607-kube-api-access-8cv8k\") pod \"payload-processing-5bf47cd988-phxp8\" (UID: \"3d00bdc0-a115-44e1-ae0c-f19613d67607\") " pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.763292 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.763223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d00bdc0-a115-44e1-ae0c-f19613d67607-plugins-config-volume\") pod \"payload-processing-5bf47cd988-phxp8\" (UID: \"3d00bdc0-a115-44e1-ae0c-f19613d67607\") " pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.763930 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.763914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d00bdc0-a115-44e1-ae0c-f19613d67607-plugins-config-volume\") pod \"payload-processing-5bf47cd988-phxp8\" (UID: \"3d00bdc0-a115-44e1-ae0c-f19613d67607\") " pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.776583 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.776559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cv8k\" (UniqueName: \"kubernetes.io/projected/3d00bdc0-a115-44e1-ae0c-f19613d67607-kube-api-access-8cv8k\") pod \"payload-processing-5bf47cd988-phxp8\" (UID: \"3d00bdc0-a115-44e1-ae0c-f19613d67607\") " pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.834348 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.834264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:01:24.849282 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.849259    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:24.864118 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.864096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdlx\" (UniqueName: \"kubernetes.io/projected/7fe84b9f-0b0a-46bc-b10a-15671c6b6f87-kube-api-access-dgdlx\") pod \"payload-pre-processing-7677b774bb-pttbc\" (UID: \"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.864212 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.864138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fe84b9f-0b0a-46bc-b10a-15671c6b6f87-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-pttbc\" (UID: \"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.864892 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.864872    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fe84b9f-0b0a-46bc-b10a-15671c6b6f87-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-pttbc\" (UID: \"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.877553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.877515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgdlx\" (UniqueName: \"kubernetes.io/projected/7fe84b9f-0b0a-46bc-b10a-15671c6b6f87-kube-api-access-dgdlx\") pod \"payload-pre-processing-7677b774bb-pttbc\" (UID: \"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.923561 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.923537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:24.999551 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:24.999526    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-phxp8"]
Jul 17 15:01:25.104248 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:25.104221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-pttbc"]
Jul 17 15:01:25.104403 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:01:25.104380    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe84b9f_0b0a_46bc_b10a_15671c6b6f87.slice/crio-270fe39f3ac15eaf0e6a093452a7b9d7627c381bf735638a870f5b9b0da83b4d WatchSource:0}: Error finding container 270fe39f3ac15eaf0e6a093452a7b9d7627c381bf735638a870f5b9b0da83b4d: Status 404 returned error can't find the container with id 270fe39f3ac15eaf0e6a093452a7b9d7627c381bf735638a870f5b9b0da83b4d
Jul 17 15:01:25.136392 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:25.136370    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc" event={"ID":"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87","Type":"ContainerStarted","Data":"270fe39f3ac15eaf0e6a093452a7b9d7627c381bf735638a870f5b9b0da83b4d"}
Jul 17 15:01:25.137590 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:25.137567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw" event={"ID":"b0c42513-faf7-4235-934e-d45362d296d4","Type":"ContainerStarted","Data":"447c1aaa047f5ed13b92837c7abbc65385bd47fdd7b3dd0bafc6c8a2a2d13ba8"}
Jul 17 15:01:25.138722 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:25.138704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-phxp8" event={"ID":"3d00bdc0-a115-44e1-ae0c-f19613d67607","Type":"ContainerStarted","Data":"8de8da7f002f7380d7a00fca84051a2f53ce2026bbd0c07067e81aac0e034978"}
Jul 17 15:01:26.156537 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:26.156495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw" event={"ID":"b0c42513-faf7-4235-934e-d45362d296d4","Type":"ContainerStarted","Data":"ef59738afbc910b92f6d07ee5e25e711664e028d9451e8c658a3c65dcb5a9be6"}
Jul 17 15:01:26.157117 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:26.157069    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:26.186905 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:26.186828    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw" podStartSLOduration=1.531071912 podStartE2EDuration="3.186809434s" totalImagesPullingTime="1.655737522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:01:26.182927077 +0000 UTC m=+699.381191418" watchObservedRunningTime="2026-07-17 15:01:26.186809434 +0000 UTC m=+699.385073772"
Jul 17 15:01:28.168222 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:28.168188    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc" event={"ID":"7fe84b9f-0b0a-46bc-b10a-15671c6b6f87","Type":"ContainerStarted","Data":"10a7d0116f750eb0d231b69f1abf1078fa22fdd332041304a2663df2b4f75240"}
Jul 17 15:01:28.168637 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:28.168252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:28.169707 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:28.169683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-phxp8" event={"ID":"3d00bdc0-a115-44e1-ae0c-f19613d67607","Type":"ContainerStarted","Data":"709e8246ac901a46501a2d7cda4811c3b0e2501ef6dc20b936da32280fa83685"}
Jul 17 15:01:28.169824 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:28.169813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:28.199118 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:28.199075    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc" podStartSLOduration=1.462319796 podStartE2EDuration="4.199062396s" totalImagesPullingTime="2.7367426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:01:28.196405178 +0000 UTC m=+701.394669517" watchObservedRunningTime="2026-07-17 15:01:28.199062396 +0000 UTC m=+701.397326725"
Jul 17 15:01:28.220561 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:28.220513    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-phxp8" podStartSLOduration=2.114660717 podStartE2EDuration="4.220498021s" totalImagesPullingTime="2.105837304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:01:28.218388797 +0000 UTC m=+701.416653137" watchObservedRunningTime="2026-07-17 15:01:28.220498021 +0000 UTC m=+701.418762363"
Jul 17 15:01:32.166763 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:32.166729    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-64bf799b45-pzcbw"
Jul 17 15:01:33.211298 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:33.211258    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:01:33.310148 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:33.310111    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:01:34.104560 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:34.104516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:01:39.177285 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:39.177210    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-pttbc"
Jul 17 15:01:39.177713 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:39.177675    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-phxp8"
Jul 17 15:01:56.572588 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.572555    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"]
Jul 17 15:01:56.577606 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.577588    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.581387 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.581363    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 15:01:56.581564 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.581414    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qmdn8\""
Jul 17 15:01:56.581564 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.581453    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 15:01:56.581564 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.581415    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 15:01:56.588326 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.588290    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"]
Jul 17 15:01:56.617161 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.617138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:01:56.617270 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.617239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.617313 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.617267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689ae9a7-6196-4f53-aa9b-adef744e38fc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.617348 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.617331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.617383 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.617353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.617424 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.617411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.617494 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.617480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftstg\" (UniqueName: \"kubernetes.io/projected/689ae9a7-6196-4f53-aa9b-adef744e38fc-kube-api-access-ftstg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.717987 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.717956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718157 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.717995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718157 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.718026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718157 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.718096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftstg\" (UniqueName: \"kubernetes.io/projected/689ae9a7-6196-4f53-aa9b-adef744e38fc-kube-api-access-ftstg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718334 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.718157    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718334 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.718180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689ae9a7-6196-4f53-aa9b-adef744e38fc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718461 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.718438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718524 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.718440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.718524 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.718494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.720424 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.720404    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689ae9a7-6196-4f53-aa9b-adef744e38fc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.720664 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.720648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689ae9a7-6196-4f53-aa9b-adef744e38fc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.728372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.728348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftstg\" (UniqueName: \"kubernetes.io/projected/689ae9a7-6196-4f53-aa9b-adef744e38fc-kube-api-access-ftstg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7\" (UID: \"689ae9a7-6196-4f53-aa9b-adef744e38fc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:56.889771 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:56.889744    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:01:57.030932 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:57.030900    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"]
Jul 17 15:01:57.032130 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:01:57.032105    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689ae9a7_6196_4f53_aa9b_adef744e38fc.slice/crio-8823c006e139a363aa9582670244184a68968cfe2bf147164ead9bfdd2e6be8e WatchSource:0}: Error finding container 8823c006e139a363aa9582670244184a68968cfe2bf147164ead9bfdd2e6be8e: Status 404 returned error can't find the container with id 8823c006e139a363aa9582670244184a68968cfe2bf147164ead9bfdd2e6be8e
Jul 17 15:01:57.316100 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:57.316012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7" event={"ID":"689ae9a7-6196-4f53-aa9b-adef744e38fc","Type":"ContainerStarted","Data":"8823c006e139a363aa9582670244184a68968cfe2bf147164ead9bfdd2e6be8e"}
Jul 17 15:01:58.322223 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:58.322177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7" event={"ID":"689ae9a7-6196-4f53-aa9b-adef744e38fc","Type":"ContainerStarted","Data":"206275fd1fac3c7e57ed0fa6ed2bf213d5f69d8a1c5d35479a5885ef01095dc5"}
Jul 17 15:01:58.345207 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:01:58.345158    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7" podStartSLOduration=1.257047743 podStartE2EDuration="2.345138707s" totalImagesPullingTime="1.088090964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:01:58.343878374 +0000 UTC m=+731.542142714" watchObservedRunningTime="2026-07-17 15:01:58.345138707 +0000 UTC m=+731.543403045"
Jul 17 15:02:06.890616 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:06.890589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:02:06.890976 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:06.890640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:02:06.902916 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:06.902891    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:02:07.377757 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:07.377727    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7"
Jul 17 15:02:10.857871 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:10.857836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:02:24.052802 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:24.052767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:02:31.362232 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:31.362191    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:02:39.629831 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:39.629796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:02:43.607529 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:43.607493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:02:46.298437 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.298401    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"]
Jul 17 15:02:46.302153 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.302130    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.304856 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.304836    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 17 15:02:46.314012 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.313988    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"]
Jul 17 15:02:46.326526 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.326501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:02:46.329544 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.329522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.329658 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.329551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.329658 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.329574    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.329658 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.329600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7g5\" (UniqueName: \"kubernetes.io/projected/a35984b3-b4b9-444c-a721-914d126f7063-kube-api-access-rq7g5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.329785 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.329677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a35984b3-b4b9-444c-a721-914d126f7063-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.329785 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.329728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.430976 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.430944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.430976 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.430973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.431247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.430993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.431247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.431017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7g5\" (UniqueName: \"kubernetes.io/projected/a35984b3-b4b9-444c-a721-914d126f7063-kube-api-access-rq7g5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.431247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.431052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a35984b3-b4b9-444c-a721-914d126f7063-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.431247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.431155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.431548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.431519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.431548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.431538    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.431716 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.431568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.433414 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.433393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a35984b3-b4b9-444c-a721-914d126f7063-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.433607 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.433582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a35984b3-b4b9-444c-a721-914d126f7063-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.441380 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.441325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7g5\" (UniqueName: \"kubernetes.io/projected/a35984b3-b4b9-444c-a721-914d126f7063-kube-api-access-rq7g5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qlb5v\" (UID: \"a35984b3-b4b9-444c-a721-914d126f7063\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.613514 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.613428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:46.748558 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:46.748531    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"]
Jul 17 15:02:46.750099 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:02:46.750072    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35984b3_b4b9_444c_a721_914d126f7063.slice/crio-0c5f975c1b503ab9ff89ad66ba6e8c04e0079211c1cca6347d35084378ff1050 WatchSource:0}: Error finding container 0c5f975c1b503ab9ff89ad66ba6e8c04e0079211c1cca6347d35084378ff1050: Status 404 returned error can't find the container with id 0c5f975c1b503ab9ff89ad66ba6e8c04e0079211c1cca6347d35084378ff1050
Jul 17 15:02:47.575028 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:47.574986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v" event={"ID":"a35984b3-b4b9-444c-a721-914d126f7063","Type":"ContainerStarted","Data":"3eb0ed1a8126ec9024adb6f6fff681fc6e9d5a679e722390d22f8a438639ccfd"}
Jul 17 15:02:47.575463 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:47.575059    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v" event={"ID":"a35984b3-b4b9-444c-a721-914d126f7063","Type":"ContainerStarted","Data":"0c5f975c1b503ab9ff89ad66ba6e8c04e0079211c1cca6347d35084378ff1050"}
Jul 17 15:02:47.604389 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:47.604338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v" podStartSLOduration=1.418206198 podStartE2EDuration="1.604321495s" totalImagesPullingTime="186.115297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:02:47.603341266 +0000 UTC m=+780.801605605" watchObservedRunningTime="2026-07-17 15:02:47.604321495 +0000 UTC m=+780.802585835"
Jul 17 15:02:56.614487 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:56.614450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:56.614975 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:56.614551    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:56.627332 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:56.627299    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:02:57.635811 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:02:57.635779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qlb5v"
Jul 17 15:03:00.838168 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:03:00.838138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:04:16.386836 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:04:16.386804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:04:16.493258 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:04:16.493226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:04:17.607472 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:04:17.607441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:04:17.709893 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:04:17.709863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:04:47.189657 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:04:47.189629    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:04:47.190255 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:04:47.189929    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:05:05.988090 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:05.988056    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-hsn5s"]
Jul 17 15:05:05.990489 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:05.988291    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s" podUID="292f29a1-6264-4b7d-95e3-5f044e998209" containerName="manager" containerID="cri-o://ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7" gracePeriod=30
Jul 17 15:05:06.238408 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.238352    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:05:06.300112 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.300081    2561 generic.go:356] "Generic (PLEG): container finished" podID="292f29a1-6264-4b7d-95e3-5f044e998209" containerID="ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7" exitCode=0
Jul 17 15:05:06.300262 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.300122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s" event={"ID":"292f29a1-6264-4b7d-95e3-5f044e998209","Type":"ContainerDied","Data":"ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7"}
Jul 17 15:05:06.300262 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.300129    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s"
Jul 17 15:05:06.300262 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.300162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-hsn5s" event={"ID":"292f29a1-6264-4b7d-95e3-5f044e998209","Type":"ContainerDied","Data":"a45345e45036b0b5ed5ea612edba34c62c22c1cf623bd147d442f68febecbe46"}
Jul 17 15:05:06.300262 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.300185    2561 scope.go:117] "RemoveContainer" containerID="ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7"
Jul 17 15:05:06.308970 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.308951    2561 scope.go:117] "RemoveContainer" containerID="ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7"
Jul 17 15:05:06.309291 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:05:06.309274    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7\": container with ID starting with ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7 not found: ID does not exist" containerID="ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7"
Jul 17 15:05:06.309339 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.309298    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7"} err="failed to get container status \"ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7\": rpc error: code = NotFound desc = could not find container \"ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7\": container with ID starting with ffc9042815dd211539710aff1cecffca3896952939c3a71320eae3b89142cac7 not found: ID does not exist"
Jul 17 15:05:06.369462 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.369435    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsm2j\" (UniqueName: \"kubernetes.io/projected/292f29a1-6264-4b7d-95e3-5f044e998209-kube-api-access-zsm2j\") pod \"292f29a1-6264-4b7d-95e3-5f044e998209\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") "
Jul 17 15:05:06.369576 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.369467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/292f29a1-6264-4b7d-95e3-5f044e998209-webhook-cert\") pod \"292f29a1-6264-4b7d-95e3-5f044e998209\" (UID: \"292f29a1-6264-4b7d-95e3-5f044e998209\") "
Jul 17 15:05:06.371646 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.371624    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292f29a1-6264-4b7d-95e3-5f044e998209-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "292f29a1-6264-4b7d-95e3-5f044e998209" (UID: "292f29a1-6264-4b7d-95e3-5f044e998209"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:05:06.371739 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.371719    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292f29a1-6264-4b7d-95e3-5f044e998209-kube-api-access-zsm2j" (OuterVolumeSpecName: "kube-api-access-zsm2j") pod "292f29a1-6264-4b7d-95e3-5f044e998209" (UID: "292f29a1-6264-4b7d-95e3-5f044e998209"). InnerVolumeSpecName "kube-api-access-zsm2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:05:06.470251 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.470226    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsm2j\" (UniqueName: \"kubernetes.io/projected/292f29a1-6264-4b7d-95e3-5f044e998209-kube-api-access-zsm2j\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:05:06.470251 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.470247    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/292f29a1-6264-4b7d-95e3-5f044e998209-webhook-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:05:06.626807 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.626782    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-hsn5s"]
Jul 17 15:05:06.634566 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:06.634545    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-hsn5s"]
Jul 17 15:05:07.232793 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:07.232765    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292f29a1-6264-4b7d-95e3-5f044e998209" path="/var/lib/kubelet/pods/292f29a1-6264-4b7d-95e3-5f044e998209/volumes"
Jul 17 15:05:22.826483 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:05:22.826449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:06:07.570957 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.570924    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-7xc5c"]
Jul 17 15:06:07.571445 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.571282    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292f29a1-6264-4b7d-95e3-5f044e998209" containerName="manager"
Jul 17 15:06:07.571445 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.571293    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="292f29a1-6264-4b7d-95e3-5f044e998209" containerName="manager"
Jul 17 15:06:07.571445 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.571357    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="292f29a1-6264-4b7d-95e3-5f044e998209" containerName="manager"
Jul 17 15:06:07.574434 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.574417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:07.579219 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.579198    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-52nt7\""
Jul 17 15:06:07.579635 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.579621    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 15:06:07.580089 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.580076    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 15:06:07.597615 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.597591    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-7xc5c"]
Jul 17 15:06:07.652946 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.652922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmqvf\" (UniqueName: \"kubernetes.io/projected/2b377212-2f6f-4404-a40e-b06111410a5e-kube-api-access-vmqvf\") pod \"maas-controller-9db8d9bf9-7xc5c\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") " pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:07.653121 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.652956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b377212-2f6f-4404-a40e-b06111410a5e-webhook-cert\") pod \"maas-controller-9db8d9bf9-7xc5c\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") " pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:07.753994 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.753974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmqvf\" (UniqueName: \"kubernetes.io/projected/2b377212-2f6f-4404-a40e-b06111410a5e-kube-api-access-vmqvf\") pod \"maas-controller-9db8d9bf9-7xc5c\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") " pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:07.754129 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.754009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b377212-2f6f-4404-a40e-b06111410a5e-webhook-cert\") pod \"maas-controller-9db8d9bf9-7xc5c\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") " pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:07.756436 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.756421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b377212-2f6f-4404-a40e-b06111410a5e-webhook-cert\") pod \"maas-controller-9db8d9bf9-7xc5c\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") " pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:07.765829 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.765810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmqvf\" (UniqueName: \"kubernetes.io/projected/2b377212-2f6f-4404-a40e-b06111410a5e-kube-api-access-vmqvf\") pod \"maas-controller-9db8d9bf9-7xc5c\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") " pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:07.885101 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:07.885076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:08.021506 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:08.021459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-7xc5c"]
Jul 17 15:06:08.023671 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:06:08.023648    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b377212_2f6f_4404_a40e_b06111410a5e.slice/crio-11b956b1bec3d5149b6646153e8004a3fcf02e12b4710d2d62a75e1785a76ce9 WatchSource:0}: Error finding container 11b956b1bec3d5149b6646153e8004a3fcf02e12b4710d2d62a75e1785a76ce9: Status 404 returned error can't find the container with id 11b956b1bec3d5149b6646153e8004a3fcf02e12b4710d2d62a75e1785a76ce9
Jul 17 15:06:08.617446 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:08.617412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c" event={"ID":"2b377212-2f6f-4404-a40e-b06111410a5e","Type":"ContainerStarted","Data":"78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725"}
Jul 17 15:06:08.617800 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:08.617499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:08.617800 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:08.617518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c" event={"ID":"2b377212-2f6f-4404-a40e-b06111410a5e","Type":"ContainerStarted","Data":"11b956b1bec3d5149b6646153e8004a3fcf02e12b4710d2d62a75e1785a76ce9"}
Jul 17 15:06:19.626894 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:19.626857    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:19.648496 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:19.648447    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c" podStartSLOduration=12.239894766 podStartE2EDuration="12.648431808s" totalImagesPullingTime="408.537042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:06:08.651712616 +0000 UTC m=+981.849976966" watchObservedRunningTime="2026-07-17 15:06:19.648431808 +0000 UTC m=+992.846696168"
Jul 17 15:06:24.166897 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.166864    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:06:24.283736 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.283699    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-7xc5c"]
Jul 17 15:06:24.283930 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.283895    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c" podUID="2b377212-2f6f-4404-a40e-b06111410a5e" containerName="manager" containerID="cri-o://78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725" gracePeriod=30
Jul 17 15:06:24.531874 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.531853    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:24.586383 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.586351    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b377212-2f6f-4404-a40e-b06111410a5e-webhook-cert\") pod \"2b377212-2f6f-4404-a40e-b06111410a5e\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") "
Jul 17 15:06:24.586563 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.586437    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmqvf\" (UniqueName: \"kubernetes.io/projected/2b377212-2f6f-4404-a40e-b06111410a5e-kube-api-access-vmqvf\") pod \"2b377212-2f6f-4404-a40e-b06111410a5e\" (UID: \"2b377212-2f6f-4404-a40e-b06111410a5e\") "
Jul 17 15:06:24.588473 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.588437    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b377212-2f6f-4404-a40e-b06111410a5e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2b377212-2f6f-4404-a40e-b06111410a5e" (UID: "2b377212-2f6f-4404-a40e-b06111410a5e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:06:24.588613 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.588529    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b377212-2f6f-4404-a40e-b06111410a5e-kube-api-access-vmqvf" (OuterVolumeSpecName: "kube-api-access-vmqvf") pod "2b377212-2f6f-4404-a40e-b06111410a5e" (UID: "2b377212-2f6f-4404-a40e-b06111410a5e"). InnerVolumeSpecName "kube-api-access-vmqvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:06:24.687280 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.687242    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b377212-2f6f-4404-a40e-b06111410a5e-webhook-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:06:24.687280 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.687280    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmqvf\" (UniqueName: \"kubernetes.io/projected/2b377212-2f6f-4404-a40e-b06111410a5e-kube-api-access-vmqvf\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:06:24.701034 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.701009    2561 generic.go:356] "Generic (PLEG): container finished" podID="2b377212-2f6f-4404-a40e-b06111410a5e" containerID="78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725" exitCode=0
Jul 17 15:06:24.701153 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.701068    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c"
Jul 17 15:06:24.701153 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.701068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c" event={"ID":"2b377212-2f6f-4404-a40e-b06111410a5e","Type":"ContainerDied","Data":"78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725"}
Jul 17 15:06:24.701227 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.701180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-7xc5c" event={"ID":"2b377212-2f6f-4404-a40e-b06111410a5e","Type":"ContainerDied","Data":"11b956b1bec3d5149b6646153e8004a3fcf02e12b4710d2d62a75e1785a76ce9"}
Jul 17 15:06:24.701227 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.701205    2561 scope.go:117] "RemoveContainer" containerID="78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725"
Jul 17 15:06:24.710685 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.710666    2561 scope.go:117] "RemoveContainer" containerID="78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725"
Jul 17 15:06:24.710921 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:06:24.710902    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725\": container with ID starting with 78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725 not found: ID does not exist" containerID="78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725"
Jul 17 15:06:24.710967 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.710930    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725"} err="failed to get container status \"78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725\": rpc error: code = NotFound desc = could not find container \"78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725\": container with ID starting with 78e279b6712f1da83783c654158750c7c0dd782d355bf4c1ae76a88361f4d725 not found: ID does not exist"
Jul 17 15:06:24.729741 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.729714    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-7xc5c"]
Jul 17 15:06:24.734145 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:24.734118    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-7xc5c"]
Jul 17 15:06:25.232661 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.232630    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b377212-2f6f-4404-a40e-b06111410a5e" path="/var/lib/kubelet/pods/2b377212-2f6f-4404-a40e-b06111410a5e/volumes"
Jul 17 15:06:25.390307 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.390276    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:06:25.510787 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.510719    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-lnc2w"]
Jul 17 15:06:25.511134 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.511121    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b377212-2f6f-4404-a40e-b06111410a5e" containerName="manager"
Jul 17 15:06:25.511195 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.511137    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b377212-2f6f-4404-a40e-b06111410a5e" containerName="manager"
Jul 17 15:06:25.511238 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.511206    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b377212-2f6f-4404-a40e-b06111410a5e" containerName="manager"
Jul 17 15:06:25.515492 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.515476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:25.518978 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.518960    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 15:06:25.518978 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.518968    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-52nt7\""
Jul 17 15:06:25.519169 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.518999    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 15:06:25.524916 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.524895    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-lnc2w"]
Jul 17 15:06:25.595610 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.595580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p974x\" (UniqueName: \"kubernetes.io/projected/200e6c6d-4a4d-46eb-9d3f-4c8ba3016491-kube-api-access-p974x\") pod \"maas-controller-9db8d9bf9-lnc2w\" (UID: \"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491\") " pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:25.595746 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.595707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/200e6c6d-4a4d-46eb-9d3f-4c8ba3016491-webhook-cert\") pod \"maas-controller-9db8d9bf9-lnc2w\" (UID: \"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491\") " pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:25.696323 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.696297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/200e6c6d-4a4d-46eb-9d3f-4c8ba3016491-webhook-cert\") pod \"maas-controller-9db8d9bf9-lnc2w\" (UID: \"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491\") " pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:25.696435 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.696341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p974x\" (UniqueName: \"kubernetes.io/projected/200e6c6d-4a4d-46eb-9d3f-4c8ba3016491-kube-api-access-p974x\") pod \"maas-controller-9db8d9bf9-lnc2w\" (UID: \"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491\") " pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:25.698788 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.698766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/200e6c6d-4a4d-46eb-9d3f-4c8ba3016491-webhook-cert\") pod \"maas-controller-9db8d9bf9-lnc2w\" (UID: \"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491\") " pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:25.715328 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.715307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p974x\" (UniqueName: \"kubernetes.io/projected/200e6c6d-4a4d-46eb-9d3f-4c8ba3016491-kube-api-access-p974x\") pod \"maas-controller-9db8d9bf9-lnc2w\" (UID: \"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491\") " pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:25.826354 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:25.826297    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:26.182462 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:26.182437    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9db8d9bf9-lnc2w"]
Jul 17 15:06:26.184843 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:06:26.184814    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200e6c6d_4a4d_46eb_9d3f_4c8ba3016491.slice/crio-409ec4ed64c4293f481af8b82f42dbd6bfe3f8e46d3a31e03342fc0b47f949d0 WatchSource:0}: Error finding container 409ec4ed64c4293f481af8b82f42dbd6bfe3f8e46d3a31e03342fc0b47f949d0: Status 404 returned error can't find the container with id 409ec4ed64c4293f481af8b82f42dbd6bfe3f8e46d3a31e03342fc0b47f949d0
Jul 17 15:06:26.186184 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:26.186166    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:06:26.715344 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:26.715304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-lnc2w" event={"ID":"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491","Type":"ContainerStarted","Data":"f128c92df54ebd47fb4688e8e182105a0d689c6d56167e4f7b5e91106b0edd2e"}
Jul 17 15:06:26.715675 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:26.715358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9db8d9bf9-lnc2w" event={"ID":"200e6c6d-4a4d-46eb-9d3f-4c8ba3016491","Type":"ContainerStarted","Data":"409ec4ed64c4293f481af8b82f42dbd6bfe3f8e46d3a31e03342fc0b47f949d0"}
Jul 17 15:06:26.715675 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:26.715388    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:26.736374 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:26.736331    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9db8d9bf9-lnc2w" podStartSLOduration=1.3376067520000001 podStartE2EDuration="1.736317693s" totalImagesPullingTime="398.710941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:06:26.734842797 +0000 UTC m=+999.933107162" watchObservedRunningTime="2026-07-17 15:06:26.736317693 +0000 UTC m=+999.934582030"
Jul 17 15:06:31.590578 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:31.590543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:06:37.722908 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:37.722877    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9db8d9bf9-lnc2w"
Jul 17 15:06:42.260548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:42.260516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:06:58.797012 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:58.796971    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:06:58.891577 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:58.891542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:06:59.015094 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:06:59.015067    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:05.546766 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:05.546731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:05.615261 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:05.615229    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:05.822198 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:05.822127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:05.922508 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:05.922475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:06.026389 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:06.026362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:06.216360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:06.216336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:12.779383 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:12.779351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:07:12.850842 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:07:12.850807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:08:28.495011 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:08:28.494980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:08:28.595955 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:08:28.595910    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:08:51.072575 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:08:51.072543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:01.631209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:09:01.631179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:47.235669 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:09:47.235644    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:09:47.237821 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:09:47.237801    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:14:07.465742 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:07.465651    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:11.811208 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.811173    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6647f6578f-4mpgj"]
Jul 17 15:14:11.814647 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.814628    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:11.855233 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.855208    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6647f6578f-4mpgj"]
Jul 17 15:14:11.882442 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.882409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:11.910211 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.910186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-serving-cert\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:11.910296 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.910218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-service-ca\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:11.910338 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.910307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-trusted-ca-bundle\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:11.910338 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.910329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4h7m\" (UniqueName: \"kubernetes.io/projected/b4af955c-4a3f-4631-8b7f-c714a652b9a4-kube-api-access-j4h7m\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:11.910407 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.910354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-oauth-config\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:11.910407 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.910368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-config\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:11.910407 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:11.910394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-oauth-serving-cert\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.011288 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.011262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-trusted-ca-bundle\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.011430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.011291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4h7m\" (UniqueName: \"kubernetes.io/projected/b4af955c-4a3f-4631-8b7f-c714a652b9a4-kube-api-access-j4h7m\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.011430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.011313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-oauth-config\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.011430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.011328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-config\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.011430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.011350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-oauth-serving-cert\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.011430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.011397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-serving-cert\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.011430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.011415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-service-ca\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.012161 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.012138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-config\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.012249 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.012224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-service-ca\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.012431 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.012408    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-oauth-serving-cert\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.012467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.012444    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4af955c-4a3f-4631-8b7f-c714a652b9a4-trusted-ca-bundle\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.014006 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.013982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-serving-cert\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.014167 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.014147    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4af955c-4a3f-4631-8b7f-c714a652b9a4-console-oauth-config\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.016609 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.016590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:12.020715 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.020698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4h7m\" (UniqueName: \"kubernetes.io/projected/b4af955c-4a3f-4631-8b7f-c714a652b9a4-kube-api-access-j4h7m\") pod \"console-6647f6578f-4mpgj\" (UID: \"b4af955c-4a3f-4631-8b7f-c714a652b9a4\") " pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.118403 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.118328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:12.124434 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.124410    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:12.265009 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.264977    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6647f6578f-4mpgj"]
Jul 17 15:14:12.265497 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:14:12.265469    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4af955c_4a3f_4631_8b7f_c714a652b9a4.slice/crio-d5c69fd73ffb91da68bd3db9c38a22ee5cd698b6ccb4a37aab50ac7f8b1a1d0f WatchSource:0}: Error finding container d5c69fd73ffb91da68bd3db9c38a22ee5cd698b6ccb4a37aab50ac7f8b1a1d0f: Status 404 returned error can't find the container with id d5c69fd73ffb91da68bd3db9c38a22ee5cd698b6ccb4a37aab50ac7f8b1a1d0f
Jul 17 15:14:12.609839 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.609806    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:12.688358 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:12.688331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:13.128109 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:13.128074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6647f6578f-4mpgj" event={"ID":"b4af955c-4a3f-4631-8b7f-c714a652b9a4","Type":"ContainerStarted","Data":"c96ee4bf80adf1d10316ee7ff52f01b592ad352a18e43fe1bc1b899ac190ba68"}
Jul 17 15:14:13.128462 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:13.128129    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6647f6578f-4mpgj" event={"ID":"b4af955c-4a3f-4631-8b7f-c714a652b9a4","Type":"ContainerStarted","Data":"d5c69fd73ffb91da68bd3db9c38a22ee5cd698b6ccb4a37aab50ac7f8b1a1d0f"}
Jul 17 15:14:13.150429 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:13.150379    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6647f6578f-4mpgj" podStartSLOduration=2.150366304 podStartE2EDuration="2.150366304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:14:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:14:13.147690148 +0000 UTC m=+1466.345954488" watchObservedRunningTime="2026-07-17 15:14:13.150366304 +0000 UTC m=+1466.348630642"
Jul 17 15:14:22.125246 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.125166    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:22.125246 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.125246    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:22.129768 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.129747    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:22.177754 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.177724    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6647f6578f-4mpgj"
Jul 17 15:14:22.236072 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.236025    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d768ff99-rl6k5"]
Jul 17 15:14:22.369849 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.369817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:22.469144 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.469112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:22.569718 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:22.569687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:47.257145 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.257089    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74d768ff99-rl6k5" podUID="3ed37c26-51e8-44e8-9419-813af01226ff" containerName="console" containerID="cri-o://5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7" gracePeriod=15
Jul 17 15:14:47.283357 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.283335    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:14:47.283579 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.283560    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:14:47.507269 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.507206    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 15:14:47.606217 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606178    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-trusted-ca-bundle\") pod \"3ed37c26-51e8-44e8-9419-813af01226ff\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") "
Jul 17 15:14:47.606386 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606255    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-console-config\") pod \"3ed37c26-51e8-44e8-9419-813af01226ff\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") "
Jul 17 15:14:47.606386 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606303    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-service-ca\") pod \"3ed37c26-51e8-44e8-9419-813af01226ff\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") "
Jul 17 15:14:47.606386 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606367    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-serving-cert\") pod \"3ed37c26-51e8-44e8-9419-813af01226ff\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") "
Jul 17 15:14:47.606553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606412    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9bdl\" (UniqueName: \"kubernetes.io/projected/3ed37c26-51e8-44e8-9419-813af01226ff-kube-api-access-n9bdl\") pod \"3ed37c26-51e8-44e8-9419-813af01226ff\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") "
Jul 17 15:14:47.606553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606485    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-oauth-config\") pod \"3ed37c26-51e8-44e8-9419-813af01226ff\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") "
Jul 17 15:14:47.606553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606520    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-oauth-serving-cert\") pod \"3ed37c26-51e8-44e8-9419-813af01226ff\" (UID: \"3ed37c26-51e8-44e8-9419-813af01226ff\") "
Jul 17 15:14:47.606715 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-console-config" (OuterVolumeSpecName: "console-config") pod "3ed37c26-51e8-44e8-9419-813af01226ff" (UID: "3ed37c26-51e8-44e8-9419-813af01226ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:14:47.606774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606746    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ed37c26-51e8-44e8-9419-813af01226ff" (UID: "3ed37c26-51e8-44e8-9419-813af01226ff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:14:47.606834 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606808    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ed37c26-51e8-44e8-9419-813af01226ff" (UID: "3ed37c26-51e8-44e8-9419-813af01226ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:14:47.606913 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606836    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-trusted-ca-bundle\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:14:47.606959 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.606925    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-console-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:14:47.607077 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.607058    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ed37c26-51e8-44e8-9419-813af01226ff" (UID: "3ed37c26-51e8-44e8-9419-813af01226ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:14:47.608684 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.608655    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ed37c26-51e8-44e8-9419-813af01226ff" (UID: "3ed37c26-51e8-44e8-9419-813af01226ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:14:47.608792 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.608718    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ed37c26-51e8-44e8-9419-813af01226ff-kube-api-access-n9bdl" (OuterVolumeSpecName: "kube-api-access-n9bdl") pod "3ed37c26-51e8-44e8-9419-813af01226ff" (UID: "3ed37c26-51e8-44e8-9419-813af01226ff"). InnerVolumeSpecName "kube-api-access-n9bdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:14:47.608861 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.608843    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ed37c26-51e8-44e8-9419-813af01226ff" (UID: "3ed37c26-51e8-44e8-9419-813af01226ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:14:47.707615 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.707592    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-service-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:14:47.707615 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.707612    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:14:47.707750 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.707621    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9bdl\" (UniqueName: \"kubernetes.io/projected/3ed37c26-51e8-44e8-9419-813af01226ff-kube-api-access-n9bdl\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:14:47.707750 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.707631    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ed37c26-51e8-44e8-9419-813af01226ff-console-oauth-config\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:14:47.707750 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:47.707639    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ed37c26-51e8-44e8-9419-813af01226ff-oauth-serving-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:14:48.312531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.312496    2561 generic.go:356] "Generic (PLEG): container finished" podID="3ed37c26-51e8-44e8-9419-813af01226ff" containerID="5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7" exitCode=0
Jul 17 15:14:48.312988 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.312550    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d768ff99-rl6k5"
Jul 17 15:14:48.312988 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.312571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d768ff99-rl6k5" event={"ID":"3ed37c26-51e8-44e8-9419-813af01226ff","Type":"ContainerDied","Data":"5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7"}
Jul 17 15:14:48.312988 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.312635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d768ff99-rl6k5" event={"ID":"3ed37c26-51e8-44e8-9419-813af01226ff","Type":"ContainerDied","Data":"1e56f24bcdb52bfb089eac25151d41248c746f2d32f6b1abbe6181d4cc239655"}
Jul 17 15:14:48.312988 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.312667    2561 scope.go:117] "RemoveContainer" containerID="5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7"
Jul 17 15:14:48.322629 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.322614    2561 scope.go:117] "RemoveContainer" containerID="5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7"
Jul 17 15:14:48.322871 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:14:48.322854    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7\": container with ID starting with 5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7 not found: ID does not exist" containerID="5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7"
Jul 17 15:14:48.322917 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.322878    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7"} err="failed to get container status \"5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7\": rpc error: code = NotFound desc = could not find container \"5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7\": container with ID starting with 5918c5281c9cce16f8b2e2721ce109572231c8e0eaa8dac02588f85acfd67ec7 not found: ID does not exist"
Jul 17 15:14:48.341174 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.341153    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d768ff99-rl6k5"]
Jul 17 15:14:48.351815 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:48.351797    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d768ff99-rl6k5"]
Jul 17 15:14:49.232599 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:14:49.232565    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ed37c26-51e8-44e8-9419-813af01226ff" path="/var/lib/kubelet/pods/3ed37c26-51e8-44e8-9419-813af01226ff/volumes"
Jul 17 15:16:10.994141 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:16:10.994106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:32.501293 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:16:32.501258    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:32.570430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:16:32.570400    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:48.333892 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:48.333862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:48.442586 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:48.442553    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:48.721689 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:48.721661    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:55.051583 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:55.051548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:55.152548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:55.152517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:55.324872 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:55.324796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:55.421844 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:55.421817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:56.545467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.545436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:56.758876 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.758842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:56.858980 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.858906    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"]
Jul 17 15:18:56.859319 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.859305    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed37c26-51e8-44e8-9419-813af01226ff" containerName="console"
Jul 17 15:18:56.859365 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.859319    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed37c26-51e8-44e8-9419-813af01226ff" containerName="console"
Jul 17 15:18:56.859407 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.859379    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed37c26-51e8-44e8-9419-813af01226ff" containerName="console"
Jul 17 15:18:56.862598 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.862582    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:56.865537 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.865515    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8bd9392b-serving-cert\""
Jul 17 15:18:56.874613 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.874583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:56.891856 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.891834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtgc\" (UniqueName: \"kubernetes.io/projected/dfe403cf-5016-4d65-8743-2c04e4add629-kube-api-access-sjtgc\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:56.891957 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.891881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:56.891957 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.891927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe403cf-5016-4d65-8743-2c04e4add629-openshift-service-ca\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:56.958862 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.958831    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"]
Jul 17 15:18:56.992426 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.992398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtgc\" (UniqueName: \"kubernetes.io/projected/dfe403cf-5016-4d65-8743-2c04e4add629-kube-api-access-sjtgc\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:56.992574 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.992443    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:56.992574 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.992469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe403cf-5016-4d65-8743-2c04e4add629-openshift-service-ca\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:56.992653 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:18:56.992619    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-serving-cert: secret "maas-api-e2e-ait-8bd9392b-serving-cert" not found
Jul 17 15:18:56.992704 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:18:56.992692    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls podName:dfe403cf-5016-4d65-8743-2c04e4add629 nodeName:}" failed. No retries permitted until 2026-07-17 15:18:57.492669744 +0000 UTC m=+1750.690934060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls") pod "maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" (UID: "dfe403cf-5016-4d65-8743-2c04e4add629") : secret "maas-api-e2e-ait-8bd9392b-serving-cert" not found
Jul 17 15:18:56.993131 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:56.993115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe403cf-5016-4d65-8743-2c04e4add629-openshift-service-ca\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:57.004822 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.004797    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtgc\" (UniqueName: \"kubernetes.io/projected/dfe403cf-5016-4d65-8743-2c04e4add629-kube-api-access-sjtgc\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:57.496735 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.496704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:57.499385 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.499359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls\") pod \"maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:57.526467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.526439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:57.772831 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.772746    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:57.803682 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.803649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:57.900589 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.900557    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:57.919305 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.919284    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"]
Jul 17 15:18:57.921080 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:18:57.921034    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe403cf_5016_4d65_8743_2c04e4add629.slice/crio-1032be94cb75f1fd204072f5e7146d912a55c3a0f93bedc9fb5e13133eb30580 WatchSource:0}: Error finding container 1032be94cb75f1fd204072f5e7146d912a55c3a0f93bedc9fb5e13133eb30580: Status 404 returned error can't find the container with id 1032be94cb75f1fd204072f5e7146d912a55c3a0f93bedc9fb5e13133eb30580
Jul 17 15:18:57.922433 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:57.922414    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:18:58.602741 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:58.602655    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerStarted","Data":"d76de98735fe18c5a9088435ab53cd822eafec24046a65fbb867157c98b4fe20"}
Jul 17 15:18:58.602741 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:58.602709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerStarted","Data":"1032be94cb75f1fd204072f5e7146d912a55c3a0f93bedc9fb5e13133eb30580"}
Jul 17 15:18:58.602970 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:58.602874    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:18:58.622696 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:58.622653    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podStartSLOduration=2.24638921 podStartE2EDuration="2.622639715s" totalImagesPullingTime="376.250505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:58.619861533 +0000 UTC m=+1751.818125872" watchObservedRunningTime="2026-07-17 15:18:58.622639715 +0000 UTC m=+1751.820904074"
Jul 17 15:18:59.438474 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:59.438446    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:59.609897 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:59.609866    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe403cf-5016-4d65-8743-2c04e4add629" containerID="d76de98735fe18c5a9088435ab53cd822eafec24046a65fbb867157c98b4fe20" exitCode=1
Jul 17 15:18:59.610088 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:59.609951    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerDied","Data":"d76de98735fe18c5a9088435ab53cd822eafec24046a65fbb867157c98b4fe20"}
Jul 17 15:18:59.610169 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:18:59.610155    2561 scope.go:117] "RemoveContainer" containerID="d76de98735fe18c5a9088435ab53cd822eafec24046a65fbb867157c98b4fe20"
Jul 17 15:19:00.617241 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:00.617155    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe403cf-5016-4d65-8743-2c04e4add629" containerID="dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff" exitCode=1
Jul 17 15:19:00.617241 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:00.617225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerDied","Data":"dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff"}
Jul 17 15:19:00.617660 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:00.617281    2561 scope.go:117] "RemoveContainer" containerID="d76de98735fe18c5a9088435ab53cd822eafec24046a65fbb867157c98b4fe20"
Jul 17 15:19:00.617660 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:00.617493    2561 scope.go:117] "RemoveContainer" containerID="dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff"
Jul 17 15:19:00.617734 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:00.617675    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:01.624256 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:01.624227    2561 scope.go:117] "RemoveContainer" containerID="dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff"
Jul 17 15:19:01.624615 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:01.624406    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:03.603103 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:03.603074    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:19:03.603467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:03.603399    2561 scope.go:117] "RemoveContainer" containerID="dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff"
Jul 17 15:19:03.603578 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:03.603559    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:07.773567 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:07.773539    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:19:07.773952 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:07.773938    2561 scope.go:117] "RemoveContainer" containerID="dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff"
Jul 17 15:19:07.774160 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:07.774139    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:19.226699 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:19.226668    2561 scope.go:117] "RemoveContainer" containerID="dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff"
Jul 17 15:19:19.727242 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:19.727204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerStarted","Data":"4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d"}
Jul 17 15:19:19.727521 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:19.727495    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:19:20.733992 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:20.733964    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe403cf-5016-4d65-8743-2c04e4add629" containerID="4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d" exitCode=1
Jul 17 15:19:20.734405 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:20.734009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerDied","Data":"4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d"}
Jul 17 15:19:20.734405 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:20.734077    2561 scope.go:117] "RemoveContainer" containerID="dbf9951caafb82bf5339912f699256b56e77922863b38fcdda9bbf587acf29ff"
Jul 17 15:19:20.734405 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:20.734276    2561 scope.go:117] "RemoveContainer" containerID="4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d"
Jul 17 15:19:20.734521 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:20.734466    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:21.741088 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:21.741034    2561 scope.go:117] "RemoveContainer" containerID="4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d"
Jul 17 15:19:21.741550 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:21.741312    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:27.773177 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:27.773143    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:19:27.773558 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:27.773517    2561 scope.go:117] "RemoveContainer" containerID="4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d"
Jul 17 15:19:27.773730 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:27.773706    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:30.237508 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:30.237472    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:40.226222 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:40.226149    2561 scope.go:117] "RemoveContainer" containerID="4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d"
Jul 17 15:19:40.848549 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:40.848520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerStarted","Data":"320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"}
Jul 17 15:19:40.848803 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:40.848783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:19:41.855456 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:41.855424    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe403cf-5016-4d65-8743-2c04e4add629" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8" exitCode=1
Jul 17 15:19:41.855859 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:41.855470    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerDied","Data":"320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"}
Jul 17 15:19:41.855859 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:41.855518    2561 scope.go:117] "RemoveContainer" containerID="4e3cc18da01dad50c21938e4b6ffa95c223a2d8c7a3bd95ab8e484099a7ce19d"
Jul 17 15:19:41.855859 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:41.855683    2561 scope.go:117] "RemoveContainer" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"
Jul 17 15:19:41.856183 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:41.855896    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:42.862290 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:42.862259    2561 scope.go:117] "RemoveContainer" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"
Jul 17 15:19:42.862661 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:42.862465    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:47.317979 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:47.317953    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:19:47.319948 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:47.319926    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:19:47.773702 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:47.773676    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:19:47.774027 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:47.774015    2561 scope.go:117] "RemoveContainer" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"
Jul 17 15:19:47.774219 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:47.774201    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:19:58.226671 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:19:58.226637    2561 scope.go:117] "RemoveContainer" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"
Jul 17 15:19:58.227076 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:19:58.226787    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:20:11.227449 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:11.227414    2561 scope.go:117] "RemoveContainer" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"
Jul 17 15:20:11.227874 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:20:11.227640    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:20:24.226948 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:24.226918    2561 scope.go:117] "RemoveContainer" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"
Jul 17 15:20:25.081092 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:25.081066    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe403cf-5016-4d65-8743-2c04e4add629" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe" exitCode=1
Jul 17 15:20:25.081211 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:25.081105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerDied","Data":"21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"}
Jul 17 15:20:25.081211 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:25.081152    2561 scope.go:117] "RemoveContainer" containerID="320e01c19e99a9a8f5a0f7ecdcd003f7857537825b8382b3acf49b93124409e8"
Jul 17 15:20:25.081504 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:25.081486    2561 scope.go:117] "RemoveContainer" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"
Jul 17 15:20:25.081696 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:20:25.081670    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:20:25.848996 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:25.848966    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:20:26.089397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:26.089366    2561 scope.go:117] "RemoveContainer" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"
Jul 17 15:20:26.089609 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:20:26.089585    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:20:27.773113 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:27.773087    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:20:27.773479 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:27.773416    2561 scope.go:117] "RemoveContainer" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"
Jul 17 15:20:27.773615 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:20:27.773595    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:20:39.226293 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:39.226266    2561 scope.go:117] "RemoveContainer" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"
Jul 17 15:20:39.226666 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:20:39.226428    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:20:52.226323 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:20:52.226297    2561 scope.go:117] "RemoveContainer" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"
Jul 17 15:20:52.226765 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:20:52.226465    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:21:04.226518 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:04.226485    2561 scope.go:117] "RemoveContainer" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"
Jul 17 15:21:04.227014 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:04.226683    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn_odh-ai-gateway-infra(dfe403cf-5016-4d65-8743-2c04e4add629)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" podUID="dfe403cf-5016-4d65-8743-2c04e4add629"
Jul 17 15:21:12.179220 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.179139    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"]
Jul 17 15:21:12.319699 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.319673    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:21:12.322509 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.322489    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"
Jul 17 15:21:12.322626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.322514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn" event={"ID":"dfe403cf-5016-4d65-8743-2c04e4add629","Type":"ContainerDied","Data":"1032be94cb75f1fd204072f5e7146d912a55c3a0f93bedc9fb5e13133eb30580"}
Jul 17 15:21:12.322626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.322574    2561 scope.go:117] "RemoveContainer" containerID="21d9a28f8e2d33179c4788e0bb61627b7399520e2c9dd29e14dc678bc7119fbe"
Jul 17 15:21:12.400070 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.400031    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls\") pod \"dfe403cf-5016-4d65-8743-2c04e4add629\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") "
Jul 17 15:21:12.400199 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.400115    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe403cf-5016-4d65-8743-2c04e4add629-openshift-service-ca\") pod \"dfe403cf-5016-4d65-8743-2c04e4add629\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") "
Jul 17 15:21:12.400199 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.400170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjtgc\" (UniqueName: \"kubernetes.io/projected/dfe403cf-5016-4d65-8743-2c04e4add629-kube-api-access-sjtgc\") pod \"dfe403cf-5016-4d65-8743-2c04e4add629\" (UID: \"dfe403cf-5016-4d65-8743-2c04e4add629\") "
Jul 17 15:21:12.400478 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.400449    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe403cf-5016-4d65-8743-2c04e4add629-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dfe403cf-5016-4d65-8743-2c04e4add629" (UID: "dfe403cf-5016-4d65-8743-2c04e4add629"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:21:12.402427 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.402407    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dfe403cf-5016-4d65-8743-2c04e4add629" (UID: "dfe403cf-5016-4d65-8743-2c04e4add629"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:21:12.402501 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.402458    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe403cf-5016-4d65-8743-2c04e4add629-kube-api-access-sjtgc" (OuterVolumeSpecName: "kube-api-access-sjtgc") pod "dfe403cf-5016-4d65-8743-2c04e4add629" (UID: "dfe403cf-5016-4d65-8743-2c04e4add629"). InnerVolumeSpecName "kube-api-access-sjtgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:21:12.501453 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.501399    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfe403cf-5016-4d65-8743-2c04e4add629-maas-api-tls\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:21:12.501453 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.501420    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe403cf-5016-4d65-8743-2c04e4add629-openshift-service-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:21:12.501453 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.501429    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjtgc\" (UniqueName: \"kubernetes.io/projected/dfe403cf-5016-4d65-8743-2c04e4add629-kube-api-access-sjtgc\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:21:12.528774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.528745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:12.618560 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.618534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:12.646131 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.646097    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"]
Jul 17 15:21:12.650395 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:12.650372    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8bd9392b-5fbd7c4867-vt6gn"]
Jul 17 15:21:13.232383 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:13.232352    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" path="/var/lib/kubelet/pods/dfe403cf-5016-4d65-8743-2c04e4add629/volumes"
Jul 17 15:21:16.789699 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:16.789661    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:23.040831 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:23.040788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:23.096933 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:23.096906    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:26.990148 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:26.990117    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:27.329406 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.329327    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:27.429414 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.429379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:27.508279 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508239    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"]
Jul 17 15:21:27.508690 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508674    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508734 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508692    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508734 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508717    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508734 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508722    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508734 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508728    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508734 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508733    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508908 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508741    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508908 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508746    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508908 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508803    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508908 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508813    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508908 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508819    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.508908 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.508826    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:27.511836 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.511818    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.514464 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.514447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f4d42d10-gw-openshift-default-dockercfg-vnz7m\""
Jul 17 15:21:27.528487 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.528461    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"]
Jul 17 15:21:27.535431 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.535408    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:27.633053 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-envoy\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633205 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1431436-9697-40bb-889a-b44f7f267d4b-istio-podinfo\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633205 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-credential-socket\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633205 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-data\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633329 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-istio-token\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633329 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1431436-9697-40bb-889a-b44f7f267d4b-istiod-ca-cert\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633329 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cgcs\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-kube-api-access-5cgcs\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633446 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-certs\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.633489 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.633442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-socket\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734319 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-envoy\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734447 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1431436-9697-40bb-889a-b44f7f267d4b-istio-podinfo\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734447 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-credential-socket\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734520 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-data\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734520 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-istio-token\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734625 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1431436-9697-40bb-889a-b44f7f267d4b-istiod-ca-cert\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734625 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cgcs\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-kube-api-access-5cgcs\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734731 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-certs\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734731 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-socket\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-credential-socket\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.734852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-data\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.735015 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.734988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-certs\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.735015 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.735012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-socket\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.742873 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.735555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1431436-9697-40bb-889a-b44f7f267d4b-istiod-ca-cert\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.743749 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.743727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-envoy\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.743922 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.743900    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1431436-9697-40bb-889a-b44f7f267d4b-istio-podinfo\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.745874 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.745854    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-istio-token\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.745964 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.745895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cgcs\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-kube-api-access-5cgcs\") pod \"e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") " pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.822637 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.822611    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:27.961124 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:27.961096    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"]
Jul 17 15:21:27.962318 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:21:27.962289    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1431436_9697_40bb_889a_b44f7f267d4b.slice/crio-8ecff00671ac16c02216c012f02ac77458a973af3b035fcb15eccd9903575528 WatchSource:0}: Error finding container 8ecff00671ac16c02216c012f02ac77458a973af3b035fcb15eccd9903575528: Status 404 returned error can't find the container with id 8ecff00671ac16c02216c012f02ac77458a973af3b035fcb15eccd9903575528
Jul 17 15:21:28.406259 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.406228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" event={"ID":"d1431436-9697-40bb-889a-b44f7f267d4b","Type":"ContainerStarted","Data":"8ecff00671ac16c02216c012f02ac77458a973af3b035fcb15eccd9903575528"}
Jul 17 15:21:28.891318 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.891252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:28.948903 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.948876    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"]
Jul 17 15:21:28.949279 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.949265    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:28.949329 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.949281    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:28.949369 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.949360    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe403cf-5016-4d65-8743-2c04e4add629" containerName="maas-api"
Jul 17 15:21:28.953701 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.953683    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:28.957230 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.957206    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f4d42d10-serving-cert\""
Jul 17 15:21:28.965549 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.965524    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"]
Jul 17 15:21:28.988420 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:28.988385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:29.046457 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.046435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjcm\" (UniqueName: \"kubernetes.io/projected/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-kube-api-access-zcjcm\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.046580 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.046489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-maas-api-tls\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.046580 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.046557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-openshift-service-ca\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.138636 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.138605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:29.147677 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.147618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjcm\" (UniqueName: \"kubernetes.io/projected/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-kube-api-access-zcjcm\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.147677 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.147666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-maas-api-tls\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.147865 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.147719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-openshift-service-ca\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.148473 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.148431    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-openshift-service-ca\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.150760 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.150742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-maas-api-tls\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.158113 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.158093    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjcm\" (UniqueName: \"kubernetes.io/projected/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-kube-api-access-zcjcm\") pod \"maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.265091 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.265060    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:29.425767 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.425739    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"]
Jul 17 15:21:29.427574 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:21:29.427541    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac1cc9c_001e_4d88_87ec_4ca10a69d58b.slice/crio-f4b7a82810a0dbd9f14b9455e093a6cce9f2ba1a2a537b30f14ef7e998107273 WatchSource:0}: Error finding container f4b7a82810a0dbd9f14b9455e093a6cce9f2ba1a2a537b30f14ef7e998107273: Status 404 returned error can't find the container with id f4b7a82810a0dbd9f14b9455e093a6cce9f2ba1a2a537b30f14ef7e998107273
Jul 17 15:21:29.521556 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.521515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:29.621598 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:29.621563    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:30.420524 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:30.420486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" event={"ID":"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b","Type":"ContainerStarted","Data":"29e02d11087510aa5329434ef3c41d600a6ef8c4d2d948ba9d3fb06c611e72d0"}
Jul 17 15:21:30.420703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:30.420561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:30.420703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:30.420581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" event={"ID":"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b","Type":"ContainerStarted","Data":"f4b7a82810a0dbd9f14b9455e093a6cce9f2ba1a2a537b30f14ef7e998107273"}
Jul 17 15:21:30.443359 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:30.443304    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podStartSLOduration=2.025867474 podStartE2EDuration="2.443282903s" totalImagesPullingTime="417.415429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:21:30.439837244 +0000 UTC m=+1903.638101597" watchObservedRunningTime="2026-07-17 15:21:30.443282903 +0000 UTC m=+1903.641547244"
Jul 17 15:21:31.309388 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.309352    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:21:31.309501 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.309419    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:21:31.309501 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.309471    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:21:31.429886 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.429853    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerID="29e02d11087510aa5329434ef3c41d600a6ef8c4d2d948ba9d3fb06c611e72d0" exitCode=1
Jul 17 15:21:31.430105 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.429928    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" event={"ID":"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b","Type":"ContainerDied","Data":"29e02d11087510aa5329434ef3c41d600a6ef8c4d2d948ba9d3fb06c611e72d0"}
Jul 17 15:21:31.430320 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.430301    2561 scope.go:117] "RemoveContainer" containerID="29e02d11087510aa5329434ef3c41d600a6ef8c4d2d948ba9d3fb06c611e72d0"
Jul 17 15:21:31.431943 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.431900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" event={"ID":"d1431436-9697-40bb-889a-b44f7f267d4b","Type":"ContainerStarted","Data":"b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5"}
Jul 17 15:21:31.485697 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.485635    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" podStartSLOduration=1.141053403 podStartE2EDuration="4.485615636s" totalImagesPullingTime="3.344562233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:21:31.480644154 +0000 UTC m=+1904.678908492" watchObservedRunningTime="2026-07-17 15:21:31.485615636 +0000 UTC m=+1904.683879975"
Jul 17 15:21:31.822763 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:31.822736    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:32.149148 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:32.149120    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac1cc9c_001e_4d88_87ec_4ca10a69d58b.slice/crio-169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1.scope\": RecentStats: unable to find data in memory cache]"
Jul 17 15:21:32.445579 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:32.445500    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerID="169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1" exitCode=1
Jul 17 15:21:32.445744 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:32.445586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" event={"ID":"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b","Type":"ContainerDied","Data":"169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1"}
Jul 17 15:21:32.445744 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:32.445678    2561 scope.go:117] "RemoveContainer" containerID="29e02d11087510aa5329434ef3c41d600a6ef8c4d2d948ba9d3fb06c611e72d0"
Jul 17 15:21:32.445873 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:32.445858    2561 scope.go:117] "RemoveContainer" containerID="169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1"
Jul 17 15:21:32.446112 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:32.446085    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:21:32.827681 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:32.827611    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:33.452527 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:33.452498    2561 scope.go:117] "RemoveContainer" containerID="169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1"
Jul 17 15:21:33.452681 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:33.452607    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:33.452770 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:33.452746    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:21:33.453495 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:33.453478    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:35.421494 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:35.421462    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:35.421885 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:35.421818    2561 scope.go:117] "RemoveContainer" containerID="169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1"
Jul 17 15:21:35.422074 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:35.422018    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:21:39.265712 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:39.265682    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:39.266143 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:39.266128    2561 scope.go:117] "RemoveContainer" containerID="169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1"
Jul 17 15:21:39.266339 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:39.266320    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:21:43.427349 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:43.427315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:43.530148 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:43.530116    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:44.517330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:44.517255    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1431436-9697-40bb-889a-b44f7f267d4b" containerID="b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5" exitCode=0
Jul 17 15:21:44.517330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:44.517323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" event={"ID":"d1431436-9697-40bb-889a-b44f7f267d4b","Type":"ContainerDied","Data":"b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5"}
Jul 17 15:21:44.517952 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:44.517636    2561 scope.go:117] "RemoveContainer" containerID="b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5"
Jul 17 15:21:44.519507 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:44.519473    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:21:44.519621 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:44.519560    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:21:44.519621 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:44.519608    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:21:45.531625 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:45.531589    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" event={"ID":"d1431436-9697-40bb-889a-b44f7f267d4b","Type":"ContainerStarted","Data":"13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310"}
Jul 17 15:21:45.823459 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:45.823351    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:45.824865 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:45.824826    2561 patch_prober.go:28] interesting pod/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 17 15:21:45.825010 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:45.824894    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 17 15:21:46.823524 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:46.823483    2561 patch_prober.go:28] interesting pod/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 17 15:21:46.824004 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:46.823563    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 17 15:21:47.346457 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:47.346417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:47.443540 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:47.443501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:47.543079 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:47.543021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:47.823730 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:47.823694    2561 patch_prober.go:28] interesting pod/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 17 15:21:47.824316 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:47.824286    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 17 15:21:48.452798 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:48.452764    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:48.823532 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:48.823436    2561 patch_prober.go:28] interesting pod/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 17 15:21:48.823783 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:48.823754    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 17 15:21:49.827514 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:49.827482    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:49.828545 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:49.828530    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:21:51.880840 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:51.880799    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:51.981164 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:51.981124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:53.227099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:53.227074    2561 scope.go:117] "RemoveContainer" containerID="169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1"
Jul 17 15:21:54.579261 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:54.579225    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerID="812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e" exitCode=1
Jul 17 15:21:54.579676 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:54.579304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" event={"ID":"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b","Type":"ContainerDied","Data":"812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e"}
Jul 17 15:21:54.579676 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:54.579365    2561 scope.go:117] "RemoveContainer" containerID="169b4f8503e5048e717669d0bfc55cea01971712ea0a68f1519b136002793fd1"
Jul 17 15:21:54.579786 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:54.579680    2561 scope.go:117] "RemoveContainer" containerID="812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e"
Jul 17 15:21:54.579922 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:54.579900    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:21:55.421616 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:55.421585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:55.586268 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:55.586239    2561 scope.go:117] "RemoveContainer" containerID="812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e"
Jul 17 15:21:55.586716 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:55.586447    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:21:59.265326 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:59.265296    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:21:59.265786 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:21:59.265736    2561 scope.go:117] "RemoveContainer" containerID="812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e"
Jul 17 15:21:59.265970 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:21:59.265947    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:22:13.226989 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:13.226951    2561 scope.go:117] "RemoveContainer" containerID="812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e"
Jul 17 15:22:13.227428 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:13.227143    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:22:28.226891 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:28.226863    2561 scope.go:117] "RemoveContainer" containerID="812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e"
Jul 17 15:22:29.770574 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:29.770544    2561 generic.go:356] "Generic (PLEG): container finished" podID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerID="ebbb10836d3c1264c496f7b4fc99efa8ee69acfc981e7e2a2435e8c38aa99b2b" exitCode=1
Jul 17 15:22:29.770983 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:29.770585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" event={"ID":"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b","Type":"ContainerDied","Data":"ebbb10836d3c1264c496f7b4fc99efa8ee69acfc981e7e2a2435e8c38aa99b2b"}
Jul 17 15:22:29.770983 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:29.770635    2561 scope.go:117] "RemoveContainer" containerID="812ca0b57d9f580254817b82828c221402fa9b29d5a1db8c6fcdddf5f571b70e"
Jul 17 15:22:29.770983 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:29.770911    2561 scope.go:117] "RemoveContainer" containerID="ebbb10836d3c1264c496f7b4fc99efa8ee69acfc981e7e2a2435e8c38aa99b2b"
Jul 17 15:22:29.771135 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:29.771114    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:22:30.421520 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:30.421484    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:22:30.777729 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:30.777644    2561 scope.go:117] "RemoveContainer" containerID="ebbb10836d3c1264c496f7b4fc99efa8ee69acfc981e7e2a2435e8c38aa99b2b"
Jul 17 15:22:30.778124 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:30.777800    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:22:33.442949 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:33.442911    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"]
Jul 17 15:22:33.443406 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:33.443141    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy" containerID="cri-o://13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310" gracePeriod=30
Jul 17 15:22:33.527483 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:33.527442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:33.643753 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:33.643699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:34.829990 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:34.829956    2561 patch_prober.go:28] interesting pod/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 15:22:34.830409 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:34.830012    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 15:22:38.701255 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.701230    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:22:38.745804 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.745735    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-envoy\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.745804 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.745789    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1431436-9697-40bb-889a-b44f7f267d4b-istiod-ca-cert\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746004 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.745891    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-credential-socket\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746004 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.745917    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-socket\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746004 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.745984    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1431436-9697-40bb-889a-b44f7f267d4b-istio-podinfo\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746189 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746008    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-data\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746189 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746056    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-certs\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746189 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746087    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-istio-token\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746189 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746114    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cgcs\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-kube-api-access-5cgcs\") pod \"d1431436-9697-40bb-889a-b44f7f267d4b\" (UID: \"d1431436-9697-40bb-889a-b44f7f267d4b\") "
Jul 17 15:22:38.746189 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746172    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:22:38.746444 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746221    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:22:38.746444 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746335    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:22:38.746548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746451    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.746548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746468    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.746548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.746479    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.747142 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.747096    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1431436-9697-40bb-889a-b44f7f267d4b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:22:38.747718 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.747684    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:22:38.748743 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.748703    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-kube-api-access-5cgcs" (OuterVolumeSpecName: "kube-api-access-5cgcs") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "kube-api-access-5cgcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:22:38.748848 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.748771    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:22:38.749347 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.749316    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1431436-9697-40bb-889a-b44f7f267d4b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:22:38.749458 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.749322    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1431436-9697-40bb-889a-b44f7f267d4b" (UID: "d1431436-9697-40bb-889a-b44f7f267d4b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:22:38.820645 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.820612    2561 generic.go:356] "Generic (PLEG): container finished" podID="d1431436-9697-40bb-889a-b44f7f267d4b" containerID="13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310" exitCode=0
Jul 17 15:22:38.820770 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.820669    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"
Jul 17 15:22:38.820770 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.820693    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" event={"ID":"d1431436-9697-40bb-889a-b44f7f267d4b","Type":"ContainerDied","Data":"13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310"}
Jul 17 15:22:38.820770 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.820745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g" event={"ID":"d1431436-9697-40bb-889a-b44f7f267d4b","Type":"ContainerDied","Data":"8ecff00671ac16c02216c012f02ac77458a973af3b035fcb15eccd9903575528"}
Jul 17 15:22:38.820770 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.820757    2561 scope.go:117] "RemoveContainer" containerID="13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310"
Jul 17 15:22:38.830311 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.830291    2561 scope.go:117] "RemoveContainer" containerID="b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5"
Jul 17 15:22:38.838469 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.838450    2561 scope.go:117] "RemoveContainer" containerID="13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310"
Jul 17 15:22:38.838744 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:38.838717    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310\": container with ID starting with 13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310 not found: ID does not exist" containerID="13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310"
Jul 17 15:22:38.838833 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.838749    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310"} err="failed to get container status \"13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310\": rpc error: code = NotFound desc = could not find container \"13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310\": container with ID starting with 13866b166fcb46207cc95081212db918777467dc9e825fa1c1f36c3d4e8ce310 not found: ID does not exist"
Jul 17 15:22:38.838905 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.838839    2561 scope.go:117] "RemoveContainer" containerID="b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5"
Jul 17 15:22:38.839128 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:38.839108    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5\": container with ID starting with b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5 not found: ID does not exist" containerID="b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5"
Jul 17 15:22:38.839197 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.839135    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5"} err="failed to get container status \"b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5\": rpc error: code = NotFound desc = could not find container \"b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5\": container with ID starting with b4af13a44ff602498c6566e48a711b6e81e2997ce2ae052be76049a3f4b19ff5 not found: ID does not exist"
Jul 17 15:22:38.847605 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.847583    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1431436-9697-40bb-889a-b44f7f267d4b-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.847605 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.847603    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.847717 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.847612    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.847717 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.847620    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cgcs\" (UniqueName: \"kubernetes.io/projected/d1431436-9697-40bb-889a-b44f7f267d4b-kube-api-access-5cgcs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.847717 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.847630    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1431436-9697-40bb-889a-b44f7f267d4b-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.847717 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.847638    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1431436-9697-40bb-889a-b44f7f267d4b-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:38.857229 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.857210    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"]
Jul 17 15:22:38.866965 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:38.866937    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f4d42d10-gw-openshift-default-678f997d79-66k6g"]
Jul 17 15:22:39.232815 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:39.232780    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" path="/var/lib/kubelet/pods/d1431436-9697-40bb-889a-b44f7f267d4b/volumes"
Jul 17 15:22:39.266095 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:39.266069    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:22:39.266430 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:39.266417    2561 scope.go:117] "RemoveContainer" containerID="ebbb10836d3c1264c496f7b4fc99efa8ee69acfc981e7e2a2435e8c38aa99b2b"
Jul 17 15:22:39.266611 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:39.266593    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd_odh-ai-gateway-infra(9ac1cc9c-001e-4d88-87ec-4ca10a69d58b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"
Jul 17 15:22:40.662589 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.662557    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"]
Jul 17 15:22:40.723499 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.723459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:40.814461 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.814439    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:22:40.835306 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.835281    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd" event={"ID":"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b","Type":"ContainerDied","Data":"f4b7a82810a0dbd9f14b9455e093a6cce9f2ba1a2a537b30f14ef7e998107273"}
Jul 17 15:22:40.835306 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.835304    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"
Jul 17 15:22:40.835488 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.835367    2561 scope.go:117] "RemoveContainer" containerID="ebbb10836d3c1264c496f7b4fc99efa8ee69acfc981e7e2a2435e8c38aa99b2b"
Jul 17 15:22:40.861882 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.861840    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:40.862799 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.862783    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-maas-api-tls\") pod \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") "
Jul 17 15:22:40.862886 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.862861    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcjcm\" (UniqueName: \"kubernetes.io/projected/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-kube-api-access-zcjcm\") pod \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") "
Jul 17 15:22:40.862988 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.862893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-openshift-service-ca\") pod \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\" (UID: \"9ac1cc9c-001e-4d88-87ec-4ca10a69d58b\") "
Jul 17 15:22:40.863307 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.863283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" (UID: "9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:22:40.866011 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.865990    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" (UID: "9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:22:40.866124 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.866075    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-kube-api-access-zcjcm" (OuterVolumeSpecName: "kube-api-access-zcjcm") pod "9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" (UID: "9ac1cc9c-001e-4d88-87ec-4ca10a69d58b"). InnerVolumeSpecName "kube-api-access-zcjcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:22:40.964330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.964253    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-maas-api-tls\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:40.964330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.964276    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcjcm\" (UniqueName: \"kubernetes.io/projected/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-kube-api-access-zcjcm\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:40.964330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:40.964286    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b-openshift-service-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:22:41.158644 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:41.158612    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"]
Jul 17 15:22:41.163230 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:41.163207    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f4d42d10-7d98fd6bc6-rsvxd"]
Jul 17 15:22:41.232216 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:41.232146    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" path="/var/lib/kubelet/pods/9ac1cc9c-001e-4d88-87ec-4ca10a69d58b/volumes"
Jul 17 15:22:41.648346 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:41.648309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:49.320794 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.320751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:49.544113 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544083    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"]
Jul 17 15:22:49.544445 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544433    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544447    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544456    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544461    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544467    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544472    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544485    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544490    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544496    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544501    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544512    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy"
Jul 17 15:22:49.544809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544517    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy"
Jul 17 15:22:49.544809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544576    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544583    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.544809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544589    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy"
Jul 17 15:22:49.544809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544598    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1431436-9697-40bb-889a-b44f7f267d4b" containerName="istio-proxy"
Jul 17 15:22:49.544809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.544604    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:49.547607 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.547592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.553280 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.553256    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c0e88560-openshift-default-dockercfg-mfzvl\""
Jul 17 15:22:49.559366 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.559346    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:49.586622 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.586559    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"]
Jul 17 15:22:49.634922 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.634894    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e3a64-72fc-4de8-90bc-ca050e85138a-istiod-ca-cert\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635028 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.634937    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbxk\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-kube-api-access-zdbxk\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635028 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.634959    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-data\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635141 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.635065    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-credential-socket\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635141 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.635096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-podinfo\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635211 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.635151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-certs\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635211 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.635173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-envoy\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635279 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.635230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-token\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.635279 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.635251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-socket\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.680686 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.680656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:49.735837 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.735806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-credential-socket\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.735959 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.735845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-podinfo\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.735959 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.735897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-certs\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.735959 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.735924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-envoy\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.735962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-token\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-socket\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e3a64-72fc-4de8-90bc-ca050e85138a-istiod-ca-cert\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbxk\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-kube-api-access-zdbxk\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-data\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-credential-socket\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736512 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-certs\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736588 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-data\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736733 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-socket\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.736879 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.736861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e3a64-72fc-4de8-90bc-ca050e85138a-istiod-ca-cert\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.738389 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.738371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-envoy\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.738689 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.738670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-podinfo\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.749008 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.748983    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbxk\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-kube-api-access-zdbxk\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.752435 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.752411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-token\") pod \"e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") " pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:49.858681 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:49.858611    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:50.011465 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.011439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"]
Jul 17 15:22:50.014111 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:22:50.014083    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087e3a64_72fc_4de8_90bc_ca050e85138a.slice/crio-485bedc243ceb81ef0af5066131fb3d00ef8323934c0c87b7ddee2ac9ed5a4fe WatchSource:0}: Error finding container 485bedc243ceb81ef0af5066131fb3d00ef8323934c0c87b7ddee2ac9ed5a4fe: Status 404 returned error can't find the container with id 485bedc243ceb81ef0af5066131fb3d00ef8323934c0c87b7ddee2ac9ed5a4fe
Jul 17 15:22:50.016145 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.016114    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:22:50.016210 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.016177    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:22:50.016247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.016207    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:22:50.803469 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.803425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:50.891323 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.891296    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" event={"ID":"087e3a64-72fc-4de8-90bc-ca050e85138a","Type":"ContainerStarted","Data":"55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb"}
Jul 17 15:22:50.891466 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.891344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" event={"ID":"087e3a64-72fc-4de8-90bc-ca050e85138a","Type":"ContainerStarted","Data":"485bedc243ceb81ef0af5066131fb3d00ef8323934c0c87b7ddee2ac9ed5a4fe"}
Jul 17 15:22:50.957066 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.953528    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" podStartSLOduration=1.9535008710000001 podStartE2EDuration="1.953500871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:22:50.951561409 +0000 UTC m=+1984.149825751" watchObservedRunningTime="2026-07-17 15:22:50.953500871 +0000 UTC m=+1984.151765212"
Jul 17 15:22:50.974961 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.974927    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"]
Jul 17 15:22:50.975392 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.975378    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ac1cc9c-001e-4d88-87ec-4ca10a69d58b" containerName="maas-api"
Jul 17 15:22:50.978408 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.978392    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:50.981833 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:50.981815    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c0e88560-serving-cert\""
Jul 17 15:22:51.018382 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.018347    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"]
Jul 17 15:22:51.045516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.045481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d952f6-cd6f-4fe7-bb7e-3310973fa669-openshift-service-ca\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.045516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.045514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.045669 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.045564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvm5b\" (UniqueName: \"kubernetes.io/projected/54d952f6-cd6f-4fe7-bb7e-3310973fa669-kube-api-access-fvm5b\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.058317 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.058257    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:51.146332 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.146300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvm5b\" (UniqueName: \"kubernetes.io/projected/54d952f6-cd6f-4fe7-bb7e-3310973fa669-kube-api-access-fvm5b\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.146527 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.146421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d952f6-cd6f-4fe7-bb7e-3310973fa669-openshift-service-ca\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.146527 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.146455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.146648 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:51.146593    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-serving-cert: secret "maas-api-e2e-ait-c0e88560-serving-cert" not found
Jul 17 15:22:51.146709 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:51.146675    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls podName:54d952f6-cd6f-4fe7-bb7e-3310973fa669 nodeName:}" failed. No retries permitted until 2026-07-17 15:22:51.64665135 +0000 UTC m=+1984.844915665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls") pod "maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" (UID: "54d952f6-cd6f-4fe7-bb7e-3310973fa669") : secret "maas-api-e2e-ait-c0e88560-serving-cert" not found
Jul 17 15:22:51.147163 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.147143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d952f6-cd6f-4fe7-bb7e-3310973fa669-openshift-service-ca\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.179617 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.179585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvm5b\" (UniqueName: \"kubernetes.io/projected/54d952f6-cd6f-4fe7-bb7e-3310973fa669-kube-api-access-fvm5b\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.198188 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.198161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:51.383563 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.383534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:51.650492 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.650413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.652811 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.652785    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls\") pod \"maas-api-e2e-ait-c0e88560-694b6cf557-48gf6\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.859339 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.859310    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:51.864343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.864323    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:51.888921 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.888899    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:51.897454 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.897421    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:51.898181 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:51.898162    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:22:52.085538 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.085506    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"]
Jul 17 15:22:52.085661 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:22:52.085584    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d952f6_cd6f_4fe7_bb7e_3310973fa669.slice/crio-902b1e5c63a108f5c0facb044a45b4d1ec54b0265d59f1aefbbf20510d0f1040 WatchSource:0}: Error finding container 902b1e5c63a108f5c0facb044a45b4d1ec54b0265d59f1aefbbf20510d0f1040: Status 404 returned error can't find the container with id 902b1e5c63a108f5c0facb044a45b4d1ec54b0265d59f1aefbbf20510d0f1040
Jul 17 15:22:52.109760 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.109736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:52.353114 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.353000    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:52.875344 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.875316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:52.904400 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.904367    2561 generic.go:356] "Generic (PLEG): container finished" podID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerID="54e35d6416ed8314456122d587552fc156c2d0c529d6d138616957a9e4f7a929" exitCode=1
Jul 17 15:22:52.904516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.904448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" event={"ID":"54d952f6-cd6f-4fe7-bb7e-3310973fa669","Type":"ContainerDied","Data":"54e35d6416ed8314456122d587552fc156c2d0c529d6d138616957a9e4f7a929"}
Jul 17 15:22:52.904516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.904498    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" event={"ID":"54d952f6-cd6f-4fe7-bb7e-3310973fa669","Type":"ContainerStarted","Data":"902b1e5c63a108f5c0facb044a45b4d1ec54b0265d59f1aefbbf20510d0f1040"}
Jul 17 15:22:52.904735 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:52.904722    2561 scope.go:117] "RemoveContainer" containerID="54e35d6416ed8314456122d587552fc156c2d0c529d6d138616957a9e4f7a929"
Jul 17 15:22:53.911732 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:53.911700    2561 generic.go:356] "Generic (PLEG): container finished" podID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerID="2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a" exitCode=1
Jul 17 15:22:53.912209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:53.911772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" event={"ID":"54d952f6-cd6f-4fe7-bb7e-3310973fa669","Type":"ContainerDied","Data":"2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a"}
Jul 17 15:22:53.912209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:53.911828    2561 scope.go:117] "RemoveContainer" containerID="54e35d6416ed8314456122d587552fc156c2d0c529d6d138616957a9e4f7a929"
Jul 17 15:22:53.912209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:53.912028    2561 scope.go:117] "RemoveContainer" containerID="2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a"
Jul 17 15:22:53.912378 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:53.912265    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:22:54.919198 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:54.919172    2561 scope.go:117] "RemoveContainer" containerID="2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a"
Jul 17 15:22:54.919575 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:54.919341    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:22:56.889337 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:56.889308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:22:56.889714 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:22:56.889700    2561 scope.go:117] "RemoveContainer" containerID="2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a"
Jul 17 15:22:56.889878 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:22:56.889860    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:01.889620 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:01.889590    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:23:01.889994 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:01.889953    2561 scope.go:117] "RemoveContainer" containerID="2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a"
Jul 17 15:23:01.890199 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:01.890177    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:07.842419 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.841951    2561 patch_prober.go:28] interesting pod/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:49612->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Jul 17 15:23:07.842419 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.842015    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:49612->10.132.0.51:15021: read: connection reset by peer"
Jul 17 15:23:07.994518 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.994486    2561 generic.go:356] "Generic (PLEG): container finished" podID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerID="55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb" exitCode=0
Jul 17 15:23:07.994672 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.994545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" event={"ID":"087e3a64-72fc-4de8-90bc-ca050e85138a","Type":"ContainerDied","Data":"55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb"}
Jul 17 15:23:07.994903 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.994889    2561 scope.go:117] "RemoveContainer" containerID="55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb"
Jul 17 15:23:07.995865 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.995834    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:23:07.995930 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.995905    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:23:07.995967 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:07.995935    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:23:09.007614 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:09.007571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" event={"ID":"087e3a64-72fc-4de8-90bc-ca050e85138a","Type":"ContainerStarted","Data":"e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32"}
Jul 17 15:23:09.859347 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:09.859307    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:23:09.859619 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:09.859590    2561 patch_prober.go:28] interesting pod/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 15:23:09.859668 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:09.859642    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 15:23:10.859283 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:10.859244    2561 patch_prober.go:28] interesting pod/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 15:23:10.859688 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:10.859300    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 15:23:11.859505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:11.859469    2561 patch_prober.go:28] interesting pod/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 15:23:11.859892 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:11.859525    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 15:23:12.859170 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:12.859139    2561 patch_prober.go:28] interesting pod/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 15:23:12.859353 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:12.859194    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 15:23:13.862266 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:13.862240    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:23:13.862730 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:13.862506    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:23:13.863148 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:13.863132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:23:15.233330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:15.233293    2561 scope.go:117] "RemoveContainer" containerID="2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a"
Jul 17 15:23:16.057301 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:16.057267    2561 generic.go:356] "Generic (PLEG): container finished" podID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerID="2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e" exitCode=1
Jul 17 15:23:16.057445 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:16.057345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" event={"ID":"54d952f6-cd6f-4fe7-bb7e-3310973fa669","Type":"ContainerDied","Data":"2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e"}
Jul 17 15:23:16.057445 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:16.057408    2561 scope.go:117] "RemoveContainer" containerID="2c4d441e3fbf182e0cf2224560cba585b087b29fcfb22674ca5fd7d18e92677a"
Jul 17 15:23:16.057778 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:16.057759    2561 scope.go:117] "RemoveContainer" containerID="2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e"
Jul 17 15:23:16.058026 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:16.058008    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:16.889016 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:16.888988    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:23:17.064004 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:17.063981    2561 scope.go:117] "RemoveContainer" containerID="2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e"
Jul 17 15:23:17.064190 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:17.064172    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:21.889263 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:21.889230    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:23:21.889651 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:21.889580    2561 scope.go:117] "RemoveContainer" containerID="2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e"
Jul 17 15:23:21.889761 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:21.889743    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:35.226805 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:35.226772    2561 scope.go:117] "RemoveContainer" containerID="2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e"
Jul 17 15:23:35.227232 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:35.226937    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:46.226523 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:46.226495    2561 scope.go:117] "RemoveContainer" containerID="2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e"
Jul 17 15:23:47.230602 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:47.230519    2561 generic.go:356] "Generic (PLEG): container finished" podID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3" exitCode=1
Jul 17 15:23:47.231946 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:47.231923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" event={"ID":"54d952f6-cd6f-4fe7-bb7e-3310973fa669","Type":"ContainerDied","Data":"dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"}
Jul 17 15:23:47.232073 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:47.231976    2561 scope.go:117] "RemoveContainer" containerID="2bccf53de400c72452c11654e0995bd08d33f1d393dcb6bd28765d5c6dad099e"
Jul 17 15:23:47.232311 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:47.232293    2561 scope.go:117] "RemoveContainer" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"
Jul 17 15:23:47.232512 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:47.232488    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:51.889906 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:51.889875    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:23:51.890343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:51.889969    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:23:51.890343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:51.890292    2561 scope.go:117] "RemoveContainer" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"
Jul 17 15:23:51.890476 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:51.890456    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:23:52.259975 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:23:52.259898    2561 scope.go:117] "RemoveContainer" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"
Jul 17 15:23:52.260147 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:23:52.260085    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:24:03.859773 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:03.859717    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:07.230164 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:07.230133    2561 scope.go:117] "RemoveContainer" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"
Jul 17 15:24:07.230649 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:24:07.230330    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:24:21.226756 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:21.226678    2561 scope.go:117] "RemoveContainer" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"
Jul 17 15:24:21.227137 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:24:21.226851    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:24:36.226188 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:36.226154    2561 scope.go:117] "RemoveContainer" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"
Jul 17 15:24:36.226773 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:36.226552    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:24:37.506550 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:37.506521    2561 generic.go:356] "Generic (PLEG): container finished" podID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerID="94a64d6629fb72e11cb654d775d6503e4fce3edb480c4a29e471d3af108ddc72" exitCode=1
Jul 17 15:24:37.506991 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:37.506584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" event={"ID":"54d952f6-cd6f-4fe7-bb7e-3310973fa669","Type":"ContainerDied","Data":"94a64d6629fb72e11cb654d775d6503e4fce3edb480c4a29e471d3af108ddc72"}
Jul 17 15:24:37.506991 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:37.506645    2561 scope.go:117] "RemoveContainer" containerID="dc7c7b86db7b21512b4e2bffbb1bfbb8daffff37163fb443b131dd1ad84399d3"
Jul 17 15:24:37.506991 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:37.506960    2561 scope.go:117] "RemoveContainer" containerID="94a64d6629fb72e11cb654d775d6503e4fce3edb480c4a29e471d3af108ddc72"
Jul 17 15:24:37.507209 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:24:37.507187    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:24:41.889172 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:41.889142    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:24:41.889548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:41.889197    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:24:41.889548 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:41.889465    2561 scope.go:117] "RemoveContainer" containerID="94a64d6629fb72e11cb654d775d6503e4fce3edb480c4a29e471d3af108ddc72"
Jul 17 15:24:41.889666 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:24:41.889635    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:24:47.353552 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:47.353523    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:24:47.356646 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:47.356623    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:24:56.226865 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:24:56.226840    2561 scope.go:117] "RemoveContainer" containerID="94a64d6629fb72e11cb654d775d6503e4fce3edb480c4a29e471d3af108ddc72"
Jul 17 15:24:56.227266 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:24:56.227025    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:25:08.226551 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:08.226525    2561 scope.go:117] "RemoveContainer" containerID="94a64d6629fb72e11cb654d775d6503e4fce3edb480c4a29e471d3af108ddc72"
Jul 17 15:25:08.227013 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:25:08.226706    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-c0e88560-694b6cf557-48gf6_odh-ai-gateway-infra(54d952f6-cd6f-4fe7-bb7e-3310973fa669)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669"
Jul 17 15:25:16.009285 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.009241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:16.593793 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.593762    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"]
Jul 17 15:25:16.718053 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.718008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6" event={"ID":"54d952f6-cd6f-4fe7-bb7e-3310973fa669","Type":"ContainerDied","Data":"902b1e5c63a108f5c0facb044a45b4d1ec54b0265d59f1aefbbf20510d0f1040"}
Jul 17 15:25:16.718181 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.718079    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="902b1e5c63a108f5c0facb044a45b4d1ec54b0265d59f1aefbbf20510d0f1040"
Jul 17 15:25:16.729331 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.729309    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:25:16.768782 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.768760    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls\") pod \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") "
Jul 17 15:25:16.768931 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.768796    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvm5b\" (UniqueName: \"kubernetes.io/projected/54d952f6-cd6f-4fe7-bb7e-3310973fa669-kube-api-access-fvm5b\") pod \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") "
Jul 17 15:25:16.768931 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.768839    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d952f6-cd6f-4fe7-bb7e-3310973fa669-openshift-service-ca\") pod \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\" (UID: \"54d952f6-cd6f-4fe7-bb7e-3310973fa669\") "
Jul 17 15:25:16.769257 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.769232    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54d952f6-cd6f-4fe7-bb7e-3310973fa669-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54d952f6-cd6f-4fe7-bb7e-3310973fa669" (UID: "54d952f6-cd6f-4fe7-bb7e-3310973fa669"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:25:16.771008 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.770978    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54d952f6-cd6f-4fe7-bb7e-3310973fa669" (UID: "54d952f6-cd6f-4fe7-bb7e-3310973fa669"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:25:16.771133 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.771107    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d952f6-cd6f-4fe7-bb7e-3310973fa669-kube-api-access-fvm5b" (OuterVolumeSpecName: "kube-api-access-fvm5b") pod "54d952f6-cd6f-4fe7-bb7e-3310973fa669" (UID: "54d952f6-cd6f-4fe7-bb7e-3310973fa669"). InnerVolumeSpecName "kube-api-access-fvm5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:25:16.869875 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.869804    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d952f6-cd6f-4fe7-bb7e-3310973fa669-maas-api-tls\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:16.869875 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.869829    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvm5b\" (UniqueName: \"kubernetes.io/projected/54d952f6-cd6f-4fe7-bb7e-3310973fa669-kube-api-access-fvm5b\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:16.869875 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:16.869839    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d952f6-cd6f-4fe7-bb7e-3310973fa669-openshift-service-ca\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:17.114252 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:17.114219    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:17.723229 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:17.723196    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"
Jul 17 15:25:17.742461 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:17.742423    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"]
Jul 17 15:25:17.747000 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:17.746975    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c0e88560-694b6cf557-48gf6"]
Jul 17 15:25:19.232282 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:19.232243    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" path="/var/lib/kubelet/pods/54d952f6-cd6f-4fe7-bb7e-3310973fa669/volumes"
Jul 17 15:25:21.207288 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:21.207252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:27.658155 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:27.658116    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:27.761265 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:27.761236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:32.259697 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.259661    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"]
Jul 17 15:25:32.260153 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.259869    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy" containerID="cri-o://e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32" gracePeriod=30
Jul 17 15:25:32.284072 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.284016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:32.630443 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630412    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"]
Jul 17 15:25:32.630943 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630926    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.630943 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630945    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630957    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630963    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630977    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630982    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.630995    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.631000    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.631069    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.631077    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.631084    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.631096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.631089    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:25:32.634224 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.634208    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.643698 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.643680    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c65261cb-openshift-default-dockercfg-jcvkr\""
Jul 17 15:25:32.653842 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.653814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"]
Jul 17 15:25:32.682233 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.682205    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:32.696954 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.696925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-socket\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697134 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.696961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-envoy\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697134 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.697072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7fr\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-kube-api-access-5t7fr\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697134 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.697120    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-data\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697275 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.697179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-podinfo\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697275 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.697205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istiod-ca-cert\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697275 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.697228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-credential-socket\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697275 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.697255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-certs\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.697412 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.697326    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-token\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798340 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-socket\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798523 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-envoy\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798523 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7fr\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-kube-api-access-5t7fr\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798523 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-data\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798523 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-podinfo\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798523 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istiod-ca-cert\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798798 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-credential-socket\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798798 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-certs\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798798 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-token\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.798798 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-socket\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.799004 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.798973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-credential-socket\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.799116 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.799081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-data\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.799569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.799539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-certs\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.799744 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.799722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istiod-ca-cert\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.801144 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.801117    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-envoy\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.801355 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.801210    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-podinfo\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.815135 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.815107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-token\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.815243 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.815170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7fr\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-kube-api-access-5t7fr\") pod \"e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") " pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:32.943826 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:32.943804    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:33.098437 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.098407    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"]
Jul 17 15:25:33.098970 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:25:33.098948    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37308c3_dca9_4b0b_8bf9_f35e080f31e4.slice/crio-82a9ba6d0b6d092d0610370bc7d121c0e3559d0b132f2d3d29810c432ffd816a WatchSource:0}: Error finding container 82a9ba6d0b6d092d0610370bc7d121c0e3559d0b132f2d3d29810c432ffd816a: Status 404 returned error can't find the container with id 82a9ba6d0b6d092d0610370bc7d121c0e3559d0b132f2d3d29810c432ffd816a
Jul 17 15:25:33.101258 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.101217    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:25:33.101343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.101304    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:25:33.101384 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.101347    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:25:33.779666 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.779630    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:33.810388 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.810347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" event={"ID":"f37308c3-dca9-4b0b-8bf9-f35e080f31e4","Type":"ContainerStarted","Data":"a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904"}
Jul 17 15:25:33.810570 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.810413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" event={"ID":"f37308c3-dca9-4b0b-8bf9-f35e080f31e4","Type":"ContainerStarted","Data":"82a9ba6d0b6d092d0610370bc7d121c0e3559d0b132f2d3d29810c432ffd816a"}
Jul 17 15:25:33.843488 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.843442    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" podStartSLOduration=1.84342659 podStartE2EDuration="1.84342659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:25:33.840411819 +0000 UTC m=+2147.038676158" watchObservedRunningTime="2026-07-17 15:25:33.84342659 +0000 UTC m=+2147.041690997"
Jul 17 15:25:33.852774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.852734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:33.934611 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.934571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:33.944393 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:33.944367    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:34.421691 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:34.421652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:34.534327 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:34.534295    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:34.635290 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:34.635256    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:34.949752 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:34.949725    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:35.822146 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:35.822106    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:35.823124 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:35.823100    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:37.508925 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.508899    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:25:37.647973 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.647947    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-data\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.647988    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdbxk\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-kube-api-access-zdbxk\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648022    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-credential-socket\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648069    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-certs\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648157    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e3a64-72fc-4de8-90bc-ca050e85138a-istiod-ca-cert\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648186    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-token\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648213    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-podinfo\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648244    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-socket\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648270    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-envoy\") pod \"087e3a64-72fc-4de8-90bc-ca050e85138a\" (UID: \"087e3a64-72fc-4de8-90bc-ca050e85138a\") "
Jul 17 15:25:37.648397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648288    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:25:37.648658 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:25:37.648658 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648574    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087e3a64-72fc-4de8-90bc-ca050e85138a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:25:37.648771 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648659    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.648771 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648678    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.648771 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648730    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:25:37.649030 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.648981    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-data" (OuterVolumeSpecName: "istio-data") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:25:37.650697 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.650675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:25:37.650809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.650738    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-kube-api-access-zdbxk" (OuterVolumeSpecName: "kube-api-access-zdbxk") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "kube-api-access-zdbxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:25:37.650809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.650748    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-token" (OuterVolumeSpecName: "istio-token") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:25:37.650928 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.650907    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "087e3a64-72fc-4de8-90bc-ca050e85138a" (UID: "087e3a64-72fc-4de8-90bc-ca050e85138a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:25:37.749467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.749435    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/087e3a64-72fc-4de8-90bc-ca050e85138a-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.749467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.749462    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.749467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.749471    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.749467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.749478    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.749740 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.749485    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.749740 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.749493    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdbxk\" (UniqueName: \"kubernetes.io/projected/087e3a64-72fc-4de8-90bc-ca050e85138a-kube-api-access-zdbxk\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.749740 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.749501    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/087e3a64-72fc-4de8-90bc-ca050e85138a-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:25:37.836852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.836752    2561 generic.go:356] "Generic (PLEG): container finished" podID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerID="e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32" exitCode=0
Jul 17 15:25:37.836852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.836805    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"
Jul 17 15:25:37.836852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.836838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" event={"ID":"087e3a64-72fc-4de8-90bc-ca050e85138a","Type":"ContainerDied","Data":"e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32"}
Jul 17 15:25:37.837185 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.836900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn" event={"ID":"087e3a64-72fc-4de8-90bc-ca050e85138a","Type":"ContainerDied","Data":"485bedc243ceb81ef0af5066131fb3d00ef8323934c0c87b7ddee2ac9ed5a4fe"}
Jul 17 15:25:37.837185 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.836925    2561 scope.go:117] "RemoveContainer" containerID="e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32"
Jul 17 15:25:37.846667 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.846653    2561 scope.go:117] "RemoveContainer" containerID="55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb"
Jul 17 15:25:37.855162 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.855141    2561 scope.go:117] "RemoveContainer" containerID="e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32"
Jul 17 15:25:37.855438 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:25:37.855421    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32\": container with ID starting with e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32 not found: ID does not exist" containerID="e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32"
Jul 17 15:25:37.855481 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.855447    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32"} err="failed to get container status \"e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32\": rpc error: code = NotFound desc = could not find container \"e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32\": container with ID starting with e239aa53770a8b5d8c9a5e779dd80890e4509d301c7993bfa06733219d4b1a32 not found: ID does not exist"
Jul 17 15:25:37.855481 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.855467    2561 scope.go:117] "RemoveContainer" containerID="55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb"
Jul 17 15:25:37.855700 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:25:37.855685    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb\": container with ID starting with 55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb not found: ID does not exist" containerID="55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb"
Jul 17 15:25:37.855748 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.855707    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb"} err="failed to get container status \"55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb\": rpc error: code = NotFound desc = could not find container \"55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb\": container with ID starting with 55d8b8adba1aa26b6d96eb391274d623ab570e97d0695167ffc6b3cd59d99dfb not found: ID does not exist"
Jul 17 15:25:37.861229 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.861207    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"]
Jul 17 15:25:37.866011 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:37.865989    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c0e88560-openshift-default-7bd6dcdddf-f7tmn"]
Jul 17 15:25:39.233680 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:39.233586    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" path="/var/lib/kubelet/pods/087e3a64-72fc-4de8-90bc-ca050e85138a/volumes"
Jul 17 15:25:44.339057 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.339012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:44.443003 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.442966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:44.880223 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.880194    2561 generic.go:356] "Generic (PLEG): container finished" podID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerID="a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904" exitCode=0
Jul 17 15:25:44.880406 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.880271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" event={"ID":"f37308c3-dca9-4b0b-8bf9-f35e080f31e4","Type":"ContainerDied","Data":"a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904"}
Jul 17 15:25:44.880704 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.880687    2561 scope.go:117] "RemoveContainer" containerID="a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904"
Jul 17 15:25:44.881789 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.881760    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:25:44.881872 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.881828    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:25:44.881872 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:44.881860    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:25:45.887278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:45.887250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" event={"ID":"f37308c3-dca9-4b0b-8bf9-f35e080f31e4","Type":"ContainerStarted","Data":"6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64"}
Jul 17 15:25:45.944076 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:45.944014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:45.944317 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:45.944293    2561 patch_prober.go:28] interesting pod/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 17 15:25:45.944366 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:45.944347    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 17 15:25:46.944789 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:46.944750    2561 patch_prober.go:28] interesting pod/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 17 15:25:46.945202 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:46.944813    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 17 15:25:47.945098 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:47.945066    2561 patch_prober.go:28] interesting pod/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 17 15:25:47.945507 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:47.945132    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 17 15:25:48.110998 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:48.110960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:48.945120 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:48.945087    2561 patch_prober.go:28] interesting pod/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 17 15:25:48.945517 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:48.945142    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 17 15:25:49.948151 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:49.948127    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:49.948546 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:49.948529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:25:49.949285 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:25:49.949268    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:26:18.548937 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:26:18.548897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:26:18.649215 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:26:18.649188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:26:48.381783 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:26:48.381747    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:26:48.525161 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:26:48.525116    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:26:57.425191 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:26:57.425151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:26:57.531606 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:26:57.531571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:27:58.353587 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:27:58.353543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:27:59.037611 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:27:59.037565    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:03.622618 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:03.622588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:10.768108 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:10.768035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:10.858474 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:10.858450    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:13.864771 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:13.864736    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"]
Jul 17 15:28:13.865199 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:13.864962    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy" containerID="cri-o://6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64" gracePeriod=30
Jul 17 15:28:13.918434 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:13.918407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:14.483027 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:14.482993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:14.581627 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:14.581587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:16.118595 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:16.118564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:19.120746 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.120722    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:28:19.221708 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.221685    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t7fr\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-kube-api-access-5t7fr\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.221835 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.221723    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-token\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.221835 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.221812    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istiod-ca-cert\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.221955 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.221840    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-certs\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.221955 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.221867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-envoy\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.221955 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.221920    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-socket\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.222152 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.221958    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-podinfo\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.222152 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.222020    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-credential-socket\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.222152 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.222086    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-data\") pod \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\" (UID: \"f37308c3-dca9-4b0b-8bf9-f35e080f31e4\") "
Jul 17 15:28:19.222391 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.222358    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:28:19.222706 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.222606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:28:19.222839 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.222758    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:28:19.222839 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.222806    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:28:19.223147 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.223119    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:28:19.224139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.224111    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-kube-api-access-5t7fr" (OuterVolumeSpecName: "kube-api-access-5t7fr") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "kube-api-access-5t7fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:28:19.224139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.224108    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:28:19.224595 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.224575    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:28:19.224595 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.224589    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f37308c3-dca9-4b0b-8bf9-f35e080f31e4" (UID: "f37308c3-dca9-4b0b-8bf9-f35e080f31e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:28:19.323473 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323446    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323473 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323469    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323478    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323486    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323494    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323501    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323510    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323518    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t7fr\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-kube-api-access-5t7fr\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.323626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.323525    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37308c3-dca9-4b0b-8bf9-f35e080f31e4-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:28:19.713157 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.713124    2561 generic.go:356] "Generic (PLEG): container finished" podID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerID="6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64" exitCode=0
Jul 17 15:28:19.713356 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.713169    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"
Jul 17 15:28:19.713356 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.713210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" event={"ID":"f37308c3-dca9-4b0b-8bf9-f35e080f31e4","Type":"ContainerDied","Data":"6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64"}
Jul 17 15:28:19.713356 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.713278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5" event={"ID":"f37308c3-dca9-4b0b-8bf9-f35e080f31e4","Type":"ContainerDied","Data":"82a9ba6d0b6d092d0610370bc7d121c0e3559d0b132f2d3d29810c432ffd816a"}
Jul 17 15:28:19.713356 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.713311    2561 scope.go:117] "RemoveContainer" containerID="6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64"
Jul 17 15:28:19.724721 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.724680    2561 scope.go:117] "RemoveContainer" containerID="a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904"
Jul 17 15:28:19.733207 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.733193    2561 scope.go:117] "RemoveContainer" containerID="6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64"
Jul 17 15:28:19.733454 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:28:19.733435    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64\": container with ID starting with 6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64 not found: ID does not exist" containerID="6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64"
Jul 17 15:28:19.733529 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.733461    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64"} err="failed to get container status \"6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64\": rpc error: code = NotFound desc = could not find container \"6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64\": container with ID starting with 6a34d0527724444d5fe6944286e581794ce45e7d9650ed8bfb227e0729eeca64 not found: ID does not exist"
Jul 17 15:28:19.733529 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.733476    2561 scope.go:117] "RemoveContainer" containerID="a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904"
Jul 17 15:28:19.733713 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:28:19.733695    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904\": container with ID starting with a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904 not found: ID does not exist" containerID="a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904"
Jul 17 15:28:19.733768 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.733725    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904"} err="failed to get container status \"a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904\": rpc error: code = NotFound desc = could not find container \"a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904\": container with ID starting with a9fe7739ff5b85d554981264f92ae5f2e1e3d0f8e028620e0f240ad040665904 not found: ID does not exist"
Jul 17 15:28:19.740827 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.740796    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"]
Jul 17 15:28:19.745486 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:19.745465    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c65261cb-openshift-default-84796b4895-bs7f5"]
Jul 17 15:28:21.232460 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:21.232431    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" path="/var/lib/kubelet/pods/f37308c3-dca9-4b0b-8bf9-f35e080f31e4/volumes"
Jul 17 15:28:23.923736 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:23.923694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:24.031568 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:24.031540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:24.148587 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:24.148553    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:24.256531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:24.256449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:24.739999 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:24.739966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:35.495361 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:35.495322    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:50.679570 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:50.679536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:57.597293 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:57.597242    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:57.768934 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:57.768877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:28:57.928271 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:28:57.928238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:13.653687 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:13.653646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:15.720408 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:15.720379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:15.815153 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:15.815121    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:20.410885 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:20.410848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:20.503591 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:20.503550    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:20.603120 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:20.603087    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:31.137274 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:31.137216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:31.934563 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:31.934528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:39.125331 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:39.125266    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:39.256860 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:39.256828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:39.389139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:39.389105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:40.470247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:40.470210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:40.607475 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:40.607445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:42.190532 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:42.190498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:47.389499 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:47.389468    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:29:47.392883 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:47.392861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:29:48.948103 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:48.948077    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:49.049594 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:49.049567    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:49.644159 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:49.644132    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:56.289234 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.289190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:56.426345 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.426301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:56.516429 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.516397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:56.815897 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.815865    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"]
Jul 17 15:29:56.816363 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816349    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy"
Jul 17 15:29:56.816414 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816365    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy"
Jul 17 15:29:56.816414 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816377    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy"
Jul 17 15:29:56.816414 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816385    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy"
Jul 17 15:29:56.816414 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816400    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:29:56.816414 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816408    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:29:56.816569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816417    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy"
Jul 17 15:29:56.816569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816422    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy"
Jul 17 15:29:56.816569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816493    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d952f6-cd6f-4fe7-bb7e-3310973fa669" containerName="maas-api"
Jul 17 15:29:56.816569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816503    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy"
Jul 17 15:29:56.816569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816510    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="087e3a64-72fc-4de8-90bc-ca050e85138a" containerName="istio-proxy"
Jul 17 15:29:56.816569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816515    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy"
Jul 17 15:29:56.816569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.816523    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy"
Jul 17 15:29:56.819549 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.819533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.822168 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.822150    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-afffcc69-openshift-default-dockercfg-8rrqq\""
Jul 17 15:29:56.838329 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.838305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:56.844214 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.844188    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"]
Jul 17 15:29:56.927196 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde0a0f4-6009-4e83-a701-a17144a99fb6-istiod-ca-cert\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927196 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-socket\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927400 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-data\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927400 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-token\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927400 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crnmn\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-kube-api-access-crnmn\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927400 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-certs\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927400 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-envoy\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927564 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-podinfo\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.927564 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.927449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-credential-socket\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:56.989100 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:56.989073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:57.028460 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-socket\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028587 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-data\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028587 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-token\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028587 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crnmn\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-kube-api-access-crnmn\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028775 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-certs\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028775 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-envoy\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028898 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-podinfo\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028898 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-credential-socket\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.028898 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-socket\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.029111 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028884    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-data\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.029111 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.028966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde0a0f4-6009-4e83-a701-a17144a99fb6-istiod-ca-cert\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.029111 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.029081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-certs\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.029255 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.029120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-credential-socket\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.029561 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.029543    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde0a0f4-6009-4e83-a701-a17144a99fb6-istiod-ca-cert\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.030956 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.030937    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-envoy\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.031200 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.031184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-podinfo\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.038026 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.038003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-token\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.038637 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.038609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crnmn\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-kube-api-access-crnmn\") pod \"e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") " pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.129442 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.129414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:57.277587 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.277562    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"]
Jul 17 15:29:57.279607 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:29:57.279576    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde0a0f4_6009_4e83_a701_a17144a99fb6.slice/crio-6c139dc91115e879ba219ea8f0d909d295a219131797ebf7fd6ec51c1d3eef1a WatchSource:0}: Error finding container 6c139dc91115e879ba219ea8f0d909d295a219131797ebf7fd6ec51c1d3eef1a: Status 404 returned error can't find the container with id 6c139dc91115e879ba219ea8f0d909d295a219131797ebf7fd6ec51c1d3eef1a
Jul 17 15:29:57.281672 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.281640    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:29:57.281752 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.281705    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:29:57.281800 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:57.281749    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:29:58.235996 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:58.235963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" event={"ID":"fde0a0f4-6009-4e83-a701-a17144a99fb6","Type":"ContainerStarted","Data":"a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb"}
Jul 17 15:29:58.236361 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:58.236013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" event={"ID":"fde0a0f4-6009-4e83-a701-a17144a99fb6","Type":"ContainerStarted","Data":"6c139dc91115e879ba219ea8f0d909d295a219131797ebf7fd6ec51c1d3eef1a"}
Jul 17 15:29:58.272186 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:58.272135    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" podStartSLOduration=2.272114705 podStartE2EDuration="2.272114705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:29:58.268859625 +0000 UTC m=+2411.467123973" watchObservedRunningTime="2026-07-17 15:29:58.272114705 +0000 UTC m=+2411.470379045"
Jul 17 15:29:59.130407 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:59.130379    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:59.134900 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:59.134879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:59.240941 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:59.240912    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:29:59.241783 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:29:59.241765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:30:00.259989 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:00.259959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:00.391884 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:00.391848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:00.543652 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:00.543565    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:00.652933 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:00.652900    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:01.206514 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:01.206441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:01.387476 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:01.387439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:04.750295 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:04.750260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:05.402110 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:05.402077    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:05.583034 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:05.582995    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:05.808180 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:05.808094    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:12.580942 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:12.580903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:12.779356 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:12.779327    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:14.242321 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.242285    2561 patch_prober.go:28] interesting pod/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 15:30:14.242734 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.242349    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 15:30:14.327632 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.327601    2561 generic.go:356] "Generic (PLEG): container finished" podID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerID="a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb" exitCode=0
Jul 17 15:30:14.327792 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.327675    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" event={"ID":"fde0a0f4-6009-4e83-a701-a17144a99fb6","Type":"ContainerDied","Data":"a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb"}
Jul 17 15:30:14.328102 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.328086    2561 scope.go:117] "RemoveContainer" containerID="a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb"
Jul 17 15:30:14.329053 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.329005    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:30:14.329121 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.329106    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:30:14.329168 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:14.329140    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:30:15.335683 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:15.335648    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" event={"ID":"fde0a0f4-6009-4e83-a701-a17144a99fb6","Type":"ContainerStarted","Data":"1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7"}
Jul 17 15:30:16.130284 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:16.130245    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:30:16.130493 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:16.130473    2561 patch_prober.go:28] interesting pod/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 15:30:16.130545 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:16.130527    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 15:30:17.130629 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:17.130581    2561 patch_prober.go:28] interesting pod/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 15:30:17.131146 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:17.130651    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 15:30:18.130920 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:18.130876    2561 patch_prober.go:28] interesting pod/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 15:30:18.131391 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:18.130948    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 15:30:19.130321 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:19.130275    2561 patch_prober.go:28] interesting pod/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 15:30:19.130530 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:19.130342    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 15:30:20.133699 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:20.133670    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:30:20.134054 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:20.133932    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:30:20.134698 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:20.134679    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:30:23.426479 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:23.426445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:27.947952 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:27.947902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:34.413874 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:34.413829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:34.513091 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:34.513013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:38.623371 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:38.623339    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"]
Jul 17 15:30:38.623817 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:38.623597    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy" containerID="cri-o://1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7" gracePeriod=30
Jul 17 15:30:38.708965 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:38.708931    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:38.855958 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:38.855924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:38.980368 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:38.980336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:39.078960 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:39.078935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:39.202142 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:39.202113    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:43.874139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.874112    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:30:43.949964 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.949901    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-token\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.949964 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.949938    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde0a0f4-6009-4e83-a701-a17144a99fb6-istiod-ca-cert\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.949964 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.949965    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-envoy\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.950236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.949987    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crnmn\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-kube-api-access-crnmn\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.950236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950008    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-podinfo\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.950236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-credential-socket\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.950236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950091    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-data\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.950236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950115    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-socket\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.950236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950154    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-certs\") pod \"fde0a0f4-6009-4e83-a701-a17144a99fb6\" (UID: \"fde0a0f4-6009-4e83-a701-a17144a99fb6\") "
Jul 17 15:30:43.950553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950325    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde0a0f4-6009-4e83-a701-a17144a99fb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:30:43.950553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950394    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fde0a0f4-6009-4e83-a701-a17144a99fb6-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:43.950664 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:30:43.950664 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950645    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:30:43.950664 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950661    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:30:43.951014 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.950991    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:30:43.952316 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.952290    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:30:43.952431 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.952366    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-kube-api-access-crnmn" (OuterVolumeSpecName: "kube-api-access-crnmn") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "kube-api-access-crnmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:30:43.952802 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.952786    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:30:43.952869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:43.952793    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fde0a0f4-6009-4e83-a701-a17144a99fb6" (UID: "fde0a0f4-6009-4e83-a701-a17144a99fb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:30:44.051210 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051184    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.051210 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051207    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crnmn\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-kube-api-access-crnmn\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.051210 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051216    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.051399 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051224    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.051399 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051232    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.051399 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051240    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.051399 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051248    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fde0a0f4-6009-4e83-a701-a17144a99fb6-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.051399 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.051256    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fde0a0f4-6009-4e83-a701-a17144a99fb6-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:30:44.492667 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.492632    2561 generic.go:356] "Generic (PLEG): container finished" podID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerID="1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7" exitCode=0
Jul 17 15:30:44.492869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.492676    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"
Jul 17 15:30:44.492869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.492700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" event={"ID":"fde0a0f4-6009-4e83-a701-a17144a99fb6","Type":"ContainerDied","Data":"1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7"}
Jul 17 15:30:44.492869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.492754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx" event={"ID":"fde0a0f4-6009-4e83-a701-a17144a99fb6","Type":"ContainerDied","Data":"6c139dc91115e879ba219ea8f0d909d295a219131797ebf7fd6ec51c1d3eef1a"}
Jul 17 15:30:44.492869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.492783    2561 scope.go:117] "RemoveContainer" containerID="1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7"
Jul 17 15:30:44.504449 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.504433    2561 scope.go:117] "RemoveContainer" containerID="a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb"
Jul 17 15:30:44.513362 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.513344    2561 scope.go:117] "RemoveContainer" containerID="1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7"
Jul 17 15:30:44.513626 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:30:44.513608    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7\": container with ID starting with 1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7 not found: ID does not exist" containerID="1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7"
Jul 17 15:30:44.513683 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.513634    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7"} err="failed to get container status \"1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7\": rpc error: code = NotFound desc = could not find container \"1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7\": container with ID starting with 1cc72234eb4e0888bdf1498ee90cd3bcf26379c51133e853130377ca43884aa7 not found: ID does not exist"
Jul 17 15:30:44.513683 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.513651    2561 scope.go:117] "RemoveContainer" containerID="a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb"
Jul 17 15:30:44.513853 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:30:44.513832    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb\": container with ID starting with a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb not found: ID does not exist" containerID="a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb"
Jul 17 15:30:44.513914 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.513862    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb"} err="failed to get container status \"a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb\": rpc error: code = NotFound desc = could not find container \"a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb\": container with ID starting with a97b2f5c2ee3348f146a2ea094c8b48987ed2a9b2c0b7f977c3c39782551a8eb not found: ID does not exist"
Jul 17 15:30:44.518854 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.518833    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"]
Jul 17 15:30:44.523091 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:44.523069    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-afffcc69-openshift-default-8467d7f7f-qt6dx"]
Jul 17 15:30:45.232520 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:45.232489    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" path="/var/lib/kubelet/pods/fde0a0f4-6009-4e83-a701-a17144a99fb6/volumes"
Jul 17 15:30:45.520311 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:45.520207    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:45.592272 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:45.592238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:45.685787 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:45.685752    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:45.792266 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:45.792197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:45.886308 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:45.886257    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:47.454239 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:47.454212    2561 scope.go:117] "RemoveContainer" containerID="94a64d6629fb72e11cb654d775d6503e4fce3edb480c4a29e471d3af108ddc72"
Jul 17 15:30:50.704494 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:50.704439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:52.809984 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:52.809948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:52.913244 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:52.913208    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:59.548147 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.548112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:59.839847 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.839753    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"]
Jul 17 15:30:59.840258 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.840239    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy"
Jul 17 15:30:59.840258 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.840259    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy"
Jul 17 15:30:59.840422 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.840301    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy"
Jul 17 15:30:59.840422 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.840310    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37308c3-dca9-4b0b-8bf9-f35e080f31e4" containerName="istio-proxy"
Jul 17 15:30:59.840422 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.840401    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy"
Jul 17 15:30:59.843558 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.843537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.846193 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.846176    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a502a35a-openshift-default-dockercfg-hkhj5\""
Jul 17 15:30:59.861082 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.861062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"]
Jul 17 15:30:59.867927 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.867902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:59.960912 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.960875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:59.998927 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.998900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-credential-socket\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999080 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.998941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-data\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999080 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.998962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507c264b-c0f1-4bdd-929b-70a4815adca5-istiod-ca-cert\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999080 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.999012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-certs\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999194 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.999082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-socket\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999194 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.999105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-token\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999194 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.999156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-envoy\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999194 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.999178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wkbx\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-kube-api-access-5wkbx\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:30:59.999323 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:30:59.999244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-podinfo\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100215 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-envoy\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100215 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wkbx\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-kube-api-access-5wkbx\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100411 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-podinfo\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100411 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-credential-socket\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100411 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-data\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100411 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507c264b-c0f1-4bdd-929b-70a4815adca5-istiod-ca-cert\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100411 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-certs\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100411 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-socket\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100411 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-token\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100770 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-credential-socket\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100833 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100768    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-data\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.100910 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.100891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-socket\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.101151 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.101131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-certs\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.101250 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.101230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507c264b-c0f1-4bdd-929b-70a4815adca5-istiod-ca-cert\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.102648 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.102628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-envoy\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.102746 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.102731    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-podinfo\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.110549 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.110515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-token\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.110947 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.110925    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wkbx\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-kube-api-access-5wkbx\") pod \"e2e-mt-a502a35a-openshift-default-84d956994c-psdwq\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") " pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.153805 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.153783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:00.301188 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.301161    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"]
Jul 17 15:31:00.302574 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:31:00.302539    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507c264b_c0f1_4bdd_929b_70a4815adca5.slice/crio-27f9a79ac82c08f15ec15154f0f5508ef3e1c5e79572fb949995206d89f9cee2 WatchSource:0}: Error finding container 27f9a79ac82c08f15ec15154f0f5508ef3e1c5e79572fb949995206d89f9cee2: Status 404 returned error can't find the container with id 27f9a79ac82c08f15ec15154f0f5508ef3e1c5e79572fb949995206d89f9cee2
Jul 17 15:31:00.304659 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.304627    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:31:00.304730 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.304691    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:31:00.304730 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.304721    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:31:00.579354 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.579313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" event={"ID":"507c264b-c0f1-4bdd-929b-70a4815adca5","Type":"ContainerStarted","Data":"892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425"}
Jul 17 15:31:00.579710 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.579380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" event={"ID":"507c264b-c0f1-4bdd-929b-70a4815adca5","Type":"ContainerStarted","Data":"27f9a79ac82c08f15ec15154f0f5508ef3e1c5e79572fb949995206d89f9cee2"}
Jul 17 15:31:00.604028 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:00.603982    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" podStartSLOduration=1.6039657269999998 podStartE2EDuration="1.603965727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:31:00.602451047 +0000 UTC m=+2473.800715391" watchObservedRunningTime="2026-07-17 15:31:00.603965727 +0000 UTC m=+2473.802230130"
Jul 17 15:31:01.154277 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:01.154242    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:01.158983 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:01.158963    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:01.584959 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:01.584879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:01.585895 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:01.585878    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:02.564492 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:02.564464    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:02.668794 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:02.668755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:02.750060 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:02.749993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:03.044092 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:03.044055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:03.253260 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:03.253230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:03.360596 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:03.360516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:07.051773 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:07.051691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:13.081991 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:13.081952    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:13.660222 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:13.660190    2561 generic.go:356] "Generic (PLEG): container finished" podID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerID="892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425" exitCode=0
Jul 17 15:31:13.660381 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:13.660267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" event={"ID":"507c264b-c0f1-4bdd-929b-70a4815adca5","Type":"ContainerDied","Data":"892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425"}
Jul 17 15:31:13.660638 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:13.660625    2561 scope.go:117] "RemoveContainer" containerID="892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425"
Jul 17 15:31:13.661603 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:13.661576    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:31:13.661662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:13.661644    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:31:13.661698 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:13.661675    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:31:14.667099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:14.667066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" event={"ID":"507c264b-c0f1-4bdd-929b-70a4815adca5","Type":"ContainerStarted","Data":"39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb"}
Jul 17 15:31:15.154874 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:15.154839    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:15.156135 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:15.156109    2561 patch_prober.go:28] interesting pod/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 15:31:15.156267 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:15.156176    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 15:31:16.154477 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:16.154439    2561 patch_prober.go:28] interesting pod/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 15:31:16.154870 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:16.154503    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 15:31:16.585372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:16.585279    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:17.154728 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:17.154690    2561 patch_prober.go:28] interesting pod/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 15:31:17.155236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:17.154746    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 15:31:18.154355 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:18.154313    2561 patch_prober.go:28] interesting pod/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 17 15:31:18.154556 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:18.154379    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 17 15:31:19.166928 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:19.166901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:19.167950 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:19.167929    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:31:49.231292 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:49.231193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:49.366222 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:49.366189    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:50.939321 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:50.939275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:51.039990 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:51.039949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:51.251730 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:51.251638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:31:55.185063 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:31:55.184990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:00.266113 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:00.266060    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:14.124359 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:14.124324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:22.933585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:22.933543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:23.739315 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:23.739274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:30.048450 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:30.048402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:30.156154 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:30.156115    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:37.540724 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:37.540683    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"]
Jul 17 15:32:37.541145 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:37.540901    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy" containerID="cri-o://39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb" gracePeriod=30
Jul 17 15:32:37.561464 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:37.561436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:37.785674 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:37.785635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:38.863842 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:38.863783    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:38.972072 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:38.972015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:39.103632 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:39.103604    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:39.889992 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:39.889953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:39.990385 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:39.990352    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:41.534497 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:41.534461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:42.793790 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.793766    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:32:42.985634 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985600    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507c264b-c0f1-4bdd-929b-70a4815adca5-istiod-ca-cert\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.985634 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-certs\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.985882 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985689    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-envoy\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.985882 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985721    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-data\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.985882 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985750    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-podinfo\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.985882 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wkbx\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-kube-api-access-5wkbx\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.985882 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-token\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.986126 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985971    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-credential-socket\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.986126 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986009    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-socket\") pod \"507c264b-c0f1-4bdd-929b-70a4815adca5\" (UID: \"507c264b-c0f1-4bdd-929b-70a4815adca5\") "
Jul 17 15:32:42.986126 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.985974    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:32:42.986266 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986164    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:32:42.986266 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986084    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/507c264b-c0f1-4bdd-929b-70a4815adca5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:32:42.986379 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986306    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:32:42.986460 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986441    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:42.986528 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986464    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:42.986528 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986477    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/507c264b-c0f1-4bdd-929b-70a4815adca5-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:42.986528 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.986490    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:42.987312 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.987284    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-data" (OuterVolumeSpecName: "istio-data") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:32:42.988218 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.988190    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:32:42.988320 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.988215    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-token" (OuterVolumeSpecName: "istio-token") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:32:42.988320 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.988243    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-kube-api-access-5wkbx" (OuterVolumeSpecName: "kube-api-access-5wkbx") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "kube-api-access-5wkbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:32:42.988406 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:42.988379    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "507c264b-c0f1-4bdd-929b-70a4815adca5" (UID: "507c264b-c0f1-4bdd-929b-70a4815adca5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:32:43.087326 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.087288    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:43.087326 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.087318    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:43.087326 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.087330    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:43.087569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.087338    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wkbx\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-kube-api-access-5wkbx\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:43.087569 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.087348    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/507c264b-c0f1-4bdd-929b-70a4815adca5-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:32:43.142095 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.142028    2561 generic.go:356] "Generic (PLEG): container finished" podID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerID="39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb" exitCode=0
Jul 17 15:32:43.142095 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.142081    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" event={"ID":"507c264b-c0f1-4bdd-929b-70a4815adca5","Type":"ContainerDied","Data":"39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb"}
Jul 17 15:32:43.142360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.142125    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"
Jul 17 15:32:43.142360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.142158    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq" event={"ID":"507c264b-c0f1-4bdd-929b-70a4815adca5","Type":"ContainerDied","Data":"27f9a79ac82c08f15ec15154f0f5508ef3e1c5e79572fb949995206d89f9cee2"}
Jul 17 15:32:43.142360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.142180    2561 scope.go:117] "RemoveContainer" containerID="39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb"
Jul 17 15:32:43.152220 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.152203    2561 scope.go:117] "RemoveContainer" containerID="892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425"
Jul 17 15:32:43.160579 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.160563    2561 scope.go:117] "RemoveContainer" containerID="39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb"
Jul 17 15:32:43.160865 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:32:43.160829    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb\": container with ID starting with 39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb not found: ID does not exist" containerID="39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb"
Jul 17 15:32:43.160933 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.160864    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb"} err="failed to get container status \"39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb\": rpc error: code = NotFound desc = could not find container \"39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb\": container with ID starting with 39a7aa89559238aec462df71c6206d178c5caa90f5aba98762aa58a91d7a15fb not found: ID does not exist"
Jul 17 15:32:43.160933 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.160880    2561 scope.go:117] "RemoveContainer" containerID="892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425"
Jul 17 15:32:43.161186 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:32:43.161168    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425\": container with ID starting with 892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425 not found: ID does not exist" containerID="892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425"
Jul 17 15:32:43.161246 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.161191    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425"} err="failed to get container status \"892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425\": rpc error: code = NotFound desc = could not find container \"892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425\": container with ID starting with 892c7c555de594269e1c85864a35e11fad0dc7544629b6ab848632207c77f425 not found: ID does not exist"
Jul 17 15:32:43.180494 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.180472    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"]
Jul 17 15:32:43.190825 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.190805    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a502a35a-openshift-default-84d956994c-psdwq"]
Jul 17 15:32:43.231996 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:43.231971    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" path="/var/lib/kubelet/pods/507c264b-c0f1-4bdd-929b-70a4815adca5/volumes"
Jul 17 15:32:48.436679 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:48.436646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:48.540912 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:48.540878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:49.154594 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:49.154559    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:55.750572 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:55.750534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:55.856536 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:55.856506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:55.952412 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:55.952372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:32:57.648096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:32:57.648063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:06.474158 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:06.474107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:06.858126 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:06.858089    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:27.773138 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:27.773100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:34.220972 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.220933    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:34.302451 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.302416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:34.612851 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.612758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:34.955857 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.955820    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"]
Jul 17 15:33:34.956256 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956243    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy"
Jul 17 15:33:34.956313 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956259    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy"
Jul 17 15:33:34.956313 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956268    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy"
Jul 17 15:33:34.956313 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956273    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy"
Jul 17 15:33:34.956313 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956289    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy"
Jul 17 15:33:34.956313 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956295    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy"
Jul 17 15:33:34.956465 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956373    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde0a0f4-6009-4e83-a701-a17144a99fb6" containerName="istio-proxy"
Jul 17 15:33:34.956465 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956381    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy"
Jul 17 15:33:34.956465 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.956390    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="507c264b-c0f1-4bdd-929b-70a4815adca5" containerName="istio-proxy"
Jul 17 15:33:34.959493 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.959477    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:34.963600 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.963578    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4120cb-openshift-default-dockercfg-7nh8v\""
Jul 17 15:33:34.978022 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.977999    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"]
Jul 17 15:33:34.987927 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:34.987894    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:35.105231 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105197    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-certs\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105231 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cfc2103-1826-438d-8a91-56fed06fec97-istiod-ca-cert\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105424 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-credential-socket\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105424 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjm9b\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-kube-api-access-hjm9b\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105424 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cfc2103-1826-438d-8a91-56fed06fec97-istio-podinfo\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105424 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-istio-token\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-socket\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-data\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.105585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.105498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-envoy\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.205991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-certs\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cfc2103-1826-438d-8a91-56fed06fec97-istiod-ca-cert\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-credential-socket\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206352 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjm9b\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-kube-api-access-hjm9b\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206352 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cfc2103-1826-438d-8a91-56fed06fec97-istio-podinfo\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206352 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-istio-token\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206352 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-socket\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206352 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-data\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206352 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-envoy\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206669 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206449    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-credential-socket\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206669 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-socket\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206783 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206669    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-data\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206783 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206701    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-certs\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.206900 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.206849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cfc2103-1826-438d-8a91-56fed06fec97-istiod-ca-cert\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.208807 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.208785    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cfc2103-1826-438d-8a91-56fed06fec97-istio-podinfo\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.208899 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.208822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-envoy\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.223260 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.223240    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjm9b\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-kube-api-access-hjm9b\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.224856 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.224832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-istio-token\") pod \"e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") " pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.269947 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.269929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:35.306098 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.306060    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:35.423024 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:33:35.422995    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cfc2103_1826_438d_8a91_56fed06fec97.slice/crio-b1c1f33946244d87fee58679838abb570bed68b3df64a3ecefd5a5ff5fbbfdc8 WatchSource:0}: Error finding container b1c1f33946244d87fee58679838abb570bed68b3df64a3ecefd5a5ff5fbbfdc8: Status 404 returned error can't find the container with id b1c1f33946244d87fee58679838abb570bed68b3df64a3ecefd5a5ff5fbbfdc8
Jul 17 15:33:35.424616 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.424597    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"]
Jul 17 15:33:35.425055 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.424999    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:35.425179 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.425093    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:35.425179 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:35.425123    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:36.419428 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:36.419394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" event={"ID":"7cfc2103-1826-438d-8a91-56fed06fec97","Type":"ContainerStarted","Data":"e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c"}
Jul 17 15:33:36.419792 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:36.419455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" event={"ID":"7cfc2103-1826-438d-8a91-56fed06fec97","Type":"ContainerStarted","Data":"b1c1f33946244d87fee58679838abb570bed68b3df64a3ecefd5a5ff5fbbfdc8"}
Jul 17 15:33:36.443946 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:36.443894    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" podStartSLOduration=2.443875437 podStartE2EDuration="2.443875437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:33:36.442733882 +0000 UTC m=+2629.640998223" watchObservedRunningTime="2026-07-17 15:33:36.443875437 +0000 UTC m=+2629.642139776"
Jul 17 15:33:37.270287 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:37.270256    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:37.274848 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:37.274825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:37.424930 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:37.424906    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:37.425786 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:37.425768    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:38.540515 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:38.540480    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:38.737208 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:38.737175    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:38.912998 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:38.912968    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:39.304629 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:39.304545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:40.203432 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:40.203396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:40.349486 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:40.349458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:42.925173 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:42.925131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:43.251103 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.250992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:43.544464 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.544385    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"]
Jul 17 15:33:43.548025 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.548001    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.550590 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.550571    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c10dc4-openshift-default-dockercfg-wvnf5\""
Jul 17 15:33:43.562863 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.562840    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"]
Jul 17 15:33:43.570396 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-token\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570489 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-envoy\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570489 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-data\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570563 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-podinfo\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570563 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lndxm\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-kube-api-access-lndxm\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570633 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istiod-ca-cert\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570668 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-certs\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570702 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-credential-socket\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.570702 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.570691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-socket\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.581215 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.581185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:43.671744 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-data\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.671918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-podinfo\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.671918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lndxm\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-kube-api-access-lndxm\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.671918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istiod-ca-cert\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.671918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671864    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-certs\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.671918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-credential-socket\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.671918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-socket\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.672278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-token\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.672278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.671979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-envoy\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.672278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.672176    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-data\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.672278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.672271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-certs\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.672463 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.672311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-credential-socket\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.672463 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.672432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-socket\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.672765 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.672746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istiod-ca-cert\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.674287 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.674269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-envoy\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.674477 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.674459    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-podinfo\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.688221 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.688197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lndxm\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-kube-api-access-lndxm\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.688455 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.688429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-token\") pod \"e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") " pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:43.845636 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.845551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:43.858544 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:43.858515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:44.007617 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.007593    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"]
Jul 17 15:33:44.009186 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:33:44.009162    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53714bb3_967d_4a92_8ad2_f95e9168fd4a.slice/crio-858f0930eadd4738b2448ed4ec11f7bcd7a055a089b3850a026131255e1483a0 WatchSource:0}: Error finding container 858f0930eadd4738b2448ed4ec11f7bcd7a055a089b3850a026131255e1483a0: Status 404 returned error can't find the container with id 858f0930eadd4738b2448ed4ec11f7bcd7a055a089b3850a026131255e1483a0
Jul 17 15:33:44.011255 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.011223    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:44.011341 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.011287    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:44.011341 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.011315    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:44.464459 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.464425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" event={"ID":"53714bb3-967d-4a92-8ad2-f95e9168fd4a","Type":"ContainerStarted","Data":"965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b"}
Jul 17 15:33:44.464638 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.464504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" event={"ID":"53714bb3-967d-4a92-8ad2-f95e9168fd4a","Type":"ContainerStarted","Data":"858f0930eadd4738b2448ed4ec11f7bcd7a055a089b3850a026131255e1483a0"}
Jul 17 15:33:44.505421 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.505368    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podStartSLOduration=1.5053474 podStartE2EDuration="1.5053474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:33:44.503674781 +0000 UTC m=+2637.701939119" watchObservedRunningTime="2026-07-17 15:33:44.5053474 +0000 UTC m=+2637.703611739"
Jul 17 15:33:44.858948 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:44.858873    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:45.864030 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:45.864004    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:46.475696 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:46.475665    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:46.476780 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:46.476756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:33:47.284340 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:47.284308    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:47.381176 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:47.381139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:47.487911 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:47.487874    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:47.684489 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:47.684442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:50.955190 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:50.955151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:53.467255 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:53.467208    2561 patch_prober.go:28] interesting pod/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 15:33:53.467679 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:53.467281    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 15:33:54.536803 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:54.536705    2561 generic.go:356] "Generic (PLEG): container finished" podID="7cfc2103-1826-438d-8a91-56fed06fec97" containerID="e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c" exitCode=0
Jul 17 15:33:54.537236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:54.536900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" event={"ID":"7cfc2103-1826-438d-8a91-56fed06fec97","Type":"ContainerDied","Data":"e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c"}
Jul 17 15:33:54.537547 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:54.537527    2561 scope.go:117] "RemoveContainer" containerID="e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c"
Jul 17 15:33:54.539212 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:54.539164    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:54.539335 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:54.539312    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:54.539421 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:54.539405    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:33:55.552902 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:55.552849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" event={"ID":"7cfc2103-1826-438d-8a91-56fed06fec97","Type":"ContainerStarted","Data":"7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11"}
Jul 17 15:33:56.154300 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:56.150723    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:33:56.270453 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:56.270420    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:33:56.270638 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:56.270598    2561 patch_prober.go:28] interesting pod/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 15:33:56.270690 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:56.270654    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 15:33:57.270803 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:57.270767    2561 patch_prober.go:28] interesting pod/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 15:33:57.271225 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:57.270813    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 15:33:58.271092 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:58.271032    2561 patch_prober.go:28] interesting pod/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 15:33:58.271524 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:58.271114    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 15:33:59.271149 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:59.271112    2561 patch_prober.go:28] interesting pod/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 15:33:59.271534 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:33:59.271169    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 15:34:00.273656 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:00.273626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:34:00.274110 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:00.274021    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:34:00.274630 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:00.274613    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:34:01.477390 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.477325    2561 patch_prober.go:28] interesting pod/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 17 15:34:01.477758 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.477405    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 17 15:34:01.590691 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.590664    2561 generic.go:356] "Generic (PLEG): container finished" podID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerID="965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b" exitCode=0
Jul 17 15:34:01.590872 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.590744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" event={"ID":"53714bb3-967d-4a92-8ad2-f95e9168fd4a","Type":"ContainerDied","Data":"965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b"}
Jul 17 15:34:01.591172 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.591156    2561 scope.go:117] "RemoveContainer" containerID="965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b"
Jul 17 15:34:01.592157 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.592129    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:34:01.592252 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.592204    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:34:01.592252 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:01.592238    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:34:02.598110 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:02.598071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" event={"ID":"53714bb3-967d-4a92-8ad2-f95e9168fd4a","Type":"ContainerStarted","Data":"006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc"}
Jul 17 15:34:02.753531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:02.753497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:02.858777 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:02.858697    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:34:02.858918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:02.858833    2561 patch_prober.go:28] interesting pod/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 17 15:34:02.858918 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:02.858882    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 17 15:34:02.862467 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:02.862445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:03.859317 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:03.859272    2561 patch_prober.go:28] interesting pod/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 17 15:34:03.859788 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:03.859336    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 17 15:34:04.859594 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:04.859552    2561 patch_prober.go:28] interesting pod/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 17 15:34:04.860017 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:04.859612    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 17 15:34:05.858974 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:05.858933    2561 patch_prober.go:28] interesting pod/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 17 15:34:05.859210 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:05.858996    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 17 15:34:06.859748 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:06.859709    2561 patch_prober.go:28] interesting pod/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 17 15:34:06.860149 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:06.859767    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 17 15:34:07.863523 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:07.863489    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:34:07.864010 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:07.863911    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:34:07.864656 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:07.864638    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:34:09.824531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:09.824489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:09.922639 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:09.922603    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:19.084562 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:19.084521    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:19.148848 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:19.148813    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:24.860703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:24.860660    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:47.424982 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:47.424910    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:34:47.430654 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:47.430633    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:34:49.470330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:49.470292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:50.379024 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:50.378989    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:51.121933 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:51.121894    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:34:51.219753 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:34:51.219721    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:01.086486 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:01.086448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:05.600596 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:05.600554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:12.088106 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:12.088075    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:12.149735 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:12.149706    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:16.314546 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:16.314508    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"]
Jul 17 15:35:16.315013 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:16.314780    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy" containerID="cri-o://7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11" gracePeriod=30
Jul 17 15:35:16.335248 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:16.335220    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:16.564958 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:16.564878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:17.722626 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:17.722578    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:17.853236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:17.853204    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:21.576078 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.576056    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:35:21.673387 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673352    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-istio-token\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673545 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673414    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-certs\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673545 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673452    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjm9b\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-kube-api-access-hjm9b\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673545 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673478    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-socket\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673705 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673609    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-credential-socket\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673705 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673670    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cfc2103-1826-438d-8a91-56fed06fec97-istio-podinfo\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673826 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673705    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-data\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673826 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673727    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:21.673826 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:21.673826 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673773    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cfc2103-1826-438d-8a91-56fed06fec97-istiod-ca-cert\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.673826 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673815    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-envoy\") pod \"7cfc2103-1826-438d-8a91-56fed06fec97\" (UID: \"7cfc2103-1826-438d-8a91-56fed06fec97\") "
Jul 17 15:35:21.674130 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.673885    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:21.674197 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.674150    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.674197 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.674170    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.674197 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.674183    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.674377 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.674334    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cfc2103-1826-438d-8a91-56fed06fec97-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:35:21.674698 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.674653    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-data" (OuterVolumeSpecName: "istio-data") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:21.675999 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.675970    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-istio-token" (OuterVolumeSpecName: "istio-token") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:35:21.676254 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.676235    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:21.676326 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.676309    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-kube-api-access-hjm9b" (OuterVolumeSpecName: "kube-api-access-hjm9b") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "kube-api-access-hjm9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:35:21.676440 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.676425    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cfc2103-1826-438d-8a91-56fed06fec97-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7cfc2103-1826-438d-8a91-56fed06fec97" (UID: "7cfc2103-1826-438d-8a91-56fed06fec97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:35:21.775181 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.775148    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cfc2103-1826-438d-8a91-56fed06fec97-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.775181 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.775178    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.775181 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.775186    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.775355 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.775194    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjm9b\" (UniqueName: \"kubernetes.io/projected/7cfc2103-1826-438d-8a91-56fed06fec97-kube-api-access-hjm9b\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.775355 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.775202    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cfc2103-1826-438d-8a91-56fed06fec97-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:21.775355 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:21.775210    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cfc2103-1826-438d-8a91-56fed06fec97-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:22.044240 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.044165    2561 generic.go:356] "Generic (PLEG): container finished" podID="7cfc2103-1826-438d-8a91-56fed06fec97" containerID="7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11" exitCode=0
Jul 17 15:35:22.044240 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.044209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" event={"ID":"7cfc2103-1826-438d-8a91-56fed06fec97","Type":"ContainerDied","Data":"7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11"}
Jul 17 15:35:22.044240 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.044215    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"
Jul 17 15:35:22.044434 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.044261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv" event={"ID":"7cfc2103-1826-438d-8a91-56fed06fec97","Type":"ContainerDied","Data":"b1c1f33946244d87fee58679838abb570bed68b3df64a3ecefd5a5ff5fbbfdc8"}
Jul 17 15:35:22.044434 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.044286    2561 scope.go:117] "RemoveContainer" containerID="7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11"
Jul 17 15:35:22.054210 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.054190    2561 scope.go:117] "RemoveContainer" containerID="e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c"
Jul 17 15:35:22.062680 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.062665    2561 scope.go:117] "RemoveContainer" containerID="7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11"
Jul 17 15:35:22.062936 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:35:22.062916    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11\": container with ID starting with 7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11 not found: ID does not exist" containerID="7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11"
Jul 17 15:35:22.062983 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.062947    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11"} err="failed to get container status \"7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11\": rpc error: code = NotFound desc = could not find container \"7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11\": container with ID starting with 7c77ae68ebf1eba78d44dd7a59c66fb41d10ba75a587036ed8c7f806abe52b11 not found: ID does not exist"
Jul 17 15:35:22.062983 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.062962    2561 scope.go:117] "RemoveContainer" containerID="e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c"
Jul 17 15:35:22.063233 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:35:22.063214    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c\": container with ID starting with e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c not found: ID does not exist" containerID="e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c"
Jul 17 15:35:22.063308 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.063238    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c"} err="failed to get container status \"e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c\": rpc error: code = NotFound desc = could not find container \"e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c\": container with ID starting with e3113e43f9bc2e8aa172d243b2414ae3931f49a589e0792f4361defcae98806c not found: ID does not exist"
Jul 17 15:35:22.068515 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.068493    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"]
Jul 17 15:35:22.076090 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:22.076070    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4120cb-openshift-default-54b95458b5-7tftv"]
Jul 17 15:35:23.232555 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:23.232527    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" path="/var/lib/kubelet/pods/7cfc2103-1826-438d-8a91-56fed06fec97/volumes"
Jul 17 15:35:27.286256 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:27.286216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:31.808369 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:31.808326    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:38.186820 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:38.186782    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:38.263035 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:38.262994    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:39.427705 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:39.427663    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:42.480188 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:42.480157    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"]
Jul 17 15:35:42.480585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:42.480365    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy" containerID="cri-o://006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc" gracePeriod=30
Jul 17 15:35:42.491057 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:42.491012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:42.742555 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:42.742468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:43.086886 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.086799    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:43.390456 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.390425    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"]
Jul 17 15:35:43.390814 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.390800    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy"
Jul 17 15:35:43.390863 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.390816    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy"
Jul 17 15:35:43.390863 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.390834    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy"
Jul 17 15:35:43.390863 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.390840    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy"
Jul 17 15:35:43.390975 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.390892    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy"
Jul 17 15:35:43.393981 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.393965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.396769 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.396750    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c30485-openshift-default-dockercfg-xqn8c\""
Jul 17 15:35:43.407250 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.407226    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"]
Jul 17 15:35:43.409740 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.409718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:43.509355 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.509317    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:43.563865 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.563838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-data\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564022 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.563869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e064b16d-0569-4780-9167-370318eb8a3a-istio-podinfo\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564022 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.563888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-envoy\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564143 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.564083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-istio-token\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564143 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.564115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-credential-socket\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564214 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.564148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-certs\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564248 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.564207    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-socket\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564286 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.564265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e064b16d-0569-4780-9167-370318eb8a3a-istiod-ca-cert\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.564320 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.564288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg599\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-kube-api-access-fg599\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.664858 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.664787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-certs\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.664858 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.664825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-socket\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665085 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.664879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e064b16d-0569-4780-9167-370318eb8a3a-istiod-ca-cert\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665085 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.664910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg599\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-kube-api-access-fg599\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665085 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.664941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-data\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665085 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.664967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e064b16d-0569-4780-9167-370318eb8a3a-istio-podinfo\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665085 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.664991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-envoy\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.665126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-istio-token\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.665158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-credential-socket\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.665257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-certs\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.665299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-socket\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665537 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.665391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-data\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665537 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.665421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-credential-socket\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.665753 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.665733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e064b16d-0569-4780-9167-370318eb8a3a-istiod-ca-cert\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.667451 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.667432    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-envoy\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.667662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.667645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e064b16d-0569-4780-9167-370318eb8a3a-istio-podinfo\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.674384 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.674359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg599\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-kube-api-access-fg599\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.674484 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.674424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-istio-token\") pod \"e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") " pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.703600 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.703582    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:43.839614 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.839581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"]
Jul 17 15:35:43.841005 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:35:43.840982    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode064b16d_0569_4780_9167_370318eb8a3a.slice/crio-75e44d69aba17b557f1db9fd156a2b02992dbabc626a8547096a7c84ffda9fa3 WatchSource:0}: Error finding container 75e44d69aba17b557f1db9fd156a2b02992dbabc626a8547096a7c84ffda9fa3: Status 404 returned error can't find the container with id 75e44d69aba17b557f1db9fd156a2b02992dbabc626a8547096a7c84ffda9fa3
Jul 17 15:35:43.843345 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.843305    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:35:43.843427 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.843407    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:35:43.843473 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:43.843459    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:35:44.167458 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:44.167422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" event={"ID":"e064b16d-0569-4780-9167-370318eb8a3a","Type":"ContainerStarted","Data":"5c26db94d97d0428c3fb13544c30aed14ab90169effeb9ac72499dcc631b06bf"}
Jul 17 15:35:44.167620 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:44.167485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" event={"ID":"e064b16d-0569-4780-9167-370318eb8a3a","Type":"ContainerStarted","Data":"75e44d69aba17b557f1db9fd156a2b02992dbabc626a8547096a7c84ffda9fa3"}
Jul 17 15:35:44.197820 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:44.197772    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podStartSLOduration=1.1977538110000001 podStartE2EDuration="1.197753811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:35:44.196536078 +0000 UTC m=+2757.394800416" watchObservedRunningTime="2026-07-17 15:35:44.197753811 +0000 UTC m=+2757.396018151"
Jul 17 15:35:44.704076 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:44.704025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:44.708832 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:44.708809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:45.172544 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:45.172511    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:45.173397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:45.173380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:35:46.195653 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:46.195619    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:46.294051 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:46.294003    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:46.398493 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:46.398463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:46.998778 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:46.998748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:47.131419 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.131388    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:47.259966 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.259880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:47.731209 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.731187    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:35:47.907330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907303    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-podinfo\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-token\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907360    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-credential-socket\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907391    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-envoy\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907412    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istiod-ca-cert\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907456    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-socket\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907508    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lndxm\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-kube-api-access-lndxm\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907832 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907543    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-certs\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907832 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-data\") pod \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\" (UID: \"53714bb3-967d-4a92-8ad2-f95e9168fd4a\") "
Jul 17 15:35:47.907832 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907691    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:47.907832 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907759    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:47.908066 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907928    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:47.908066 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907948    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:47.908066 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907946    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:35:47.908066 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.907957    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:47.908652 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.908628    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:47.909860 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.909839    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:35:47.909962 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.909836    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-kube-api-access-lndxm" (OuterVolumeSpecName: "kube-api-access-lndxm") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "kube-api-access-lndxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:35:47.910264 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.910245    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:35:47.910264 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:47.910256    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "53714bb3-967d-4a92-8ad2-f95e9168fd4a" (UID: "53714bb3-967d-4a92-8ad2-f95e9168fd4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:35:48.009469 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.009438    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:48.009585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.009471    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:48.009585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.009487    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lndxm\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-kube-api-access-lndxm\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:48.009585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.009502    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:48.009585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.009514    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:48.009585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.009525    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:48.009585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.009536    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53714bb3-967d-4a92-8ad2-f95e9168fd4a-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:35:48.190139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.190016    2561 generic.go:356] "Generic (PLEG): container finished" podID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerID="006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc" exitCode=0
Jul 17 15:35:48.190139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.190100    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"
Jul 17 15:35:48.190139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.190102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" event={"ID":"53714bb3-967d-4a92-8ad2-f95e9168fd4a","Type":"ContainerDied","Data":"006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc"}
Jul 17 15:35:48.190365 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.190164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj" event={"ID":"53714bb3-967d-4a92-8ad2-f95e9168fd4a","Type":"ContainerDied","Data":"858f0930eadd4738b2448ed4ec11f7bcd7a055a089b3850a026131255e1483a0"}
Jul 17 15:35:48.190365 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.190190    2561 scope.go:117] "RemoveContainer" containerID="006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc"
Jul 17 15:35:48.200500 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.200484    2561 scope.go:117] "RemoveContainer" containerID="965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b"
Jul 17 15:35:48.208841 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.208822    2561 scope.go:117] "RemoveContainer" containerID="006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc"
Jul 17 15:35:48.209170 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:35:48.209147    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc\": container with ID starting with 006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc not found: ID does not exist" containerID="006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc"
Jul 17 15:35:48.209246 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.209178    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc"} err="failed to get container status \"006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc\": rpc error: code = NotFound desc = could not find container \"006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc\": container with ID starting with 006b92bf1f8161ce457611e4c043227402ba8fe98d693354a95884722a8d05cc not found: ID does not exist"
Jul 17 15:35:48.209246 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.209198    2561 scope.go:117] "RemoveContainer" containerID="965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b"
Jul 17 15:35:48.209467 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:35:48.209447    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b\": container with ID starting with 965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b not found: ID does not exist" containerID="965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b"
Jul 17 15:35:48.209550 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.209475    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b"} err="failed to get container status \"965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b\": rpc error: code = NotFound desc = could not find container \"965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b\": container with ID starting with 965e304f3dd40b8888ce80be9e630799a16581e9da43a98831e33e732e22bb0b not found: ID does not exist"
Jul 17 15:35:48.219510 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.219481    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"]
Jul 17 15:35:48.221770 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:48.221750    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c10dc4-openshift-default-74ffd59565-xrtkj"]
Jul 17 15:35:49.232524 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:49.232491    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" path="/var/lib/kubelet/pods/53714bb3-967d-4a92-8ad2-f95e9168fd4a/volumes"
Jul 17 15:35:50.711269 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:50.711224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:51.173239 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.173201    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:51.459913 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.459834    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"]
Jul 17 15:35:51.460272 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.460254    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy"
Jul 17 15:35:51.460335 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.460276    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy"
Jul 17 15:35:51.460335 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.460297    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy"
Jul 17 15:35:51.460335 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.460307    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy"
Jul 17 15:35:51.460459 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.460383    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cfc2103-1826-438d-8a91-56fed06fec97" containerName="istio-proxy"
Jul 17 15:35:51.460459 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.460405    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy"
Jul 17 15:35:51.460459 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.460416    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="53714bb3-967d-4a92-8ad2-f95e9168fd4a" containerName="istio-proxy"
Jul 17 15:35:51.465058 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.465020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.467505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.467485    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-818628-openshift-default-dockercfg-xdqgw\""
Jul 17 15:35:51.476552 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.476532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"]
Jul 17 15:35:51.489443 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.489417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:51.538077 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538025    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istiod-ca-cert\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538192 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-certs\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538192 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-podinfo\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538192 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-socket\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538192 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538158    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-data\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538354 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-envoy\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538354 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-credential-socket\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538354 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-token\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.538354 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.538307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xmck\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-kube-api-access-8xmck\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639368 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-socket\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639533 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-data\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639533 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-envoy\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639533 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-credential-socket\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639533 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-token\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639533 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmck\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-kube-api-access-8xmck\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639781 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istiod-ca-cert\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639781 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-certs\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639781 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-podinfo\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639931 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-socket\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.639931 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.639811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-data\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.640134 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.640107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-credential-socket\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.640134 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.640131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-certs\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.640410 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.640362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istiod-ca-cert\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.642953 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.642931    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-podinfo\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.642953 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.642945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-envoy\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.649506 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.649485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xmck\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-kube-api-access-8xmck\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.649593 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.649494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-token\") pod \"e2e-api-b-818628-openshift-default-64df8f48c-nbjjv\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") " pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.776329 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.776260    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:51.872960 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.872920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:51.933820 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.933785    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"]
Jul 17 15:35:51.934675 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:35:51.934650    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9018c7f_e2d0_46b0_b577_133f8d4a366f.slice/crio-e454a05884c00cb575d34e9333828cde818390fcdb4c7f3eee1eba86ebe22394 WatchSource:0}: Error finding container e454a05884c00cb575d34e9333828cde818390fcdb4c7f3eee1eba86ebe22394: Status 404 returned error can't find the container with id e454a05884c00cb575d34e9333828cde818390fcdb4c7f3eee1eba86ebe22394
Jul 17 15:35:51.936871 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.936838    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:35:51.936982 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.936901    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:35:51.936982 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:51.936929    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:35:52.214131 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:52.214091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" event={"ID":"f9018c7f-e2d0-46b0-b577-133f8d4a366f","Type":"ContainerStarted","Data":"014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721"}
Jul 17 15:35:52.214333 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:52.214154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" event={"ID":"f9018c7f-e2d0-46b0-b577-133f8d4a366f","Type":"ContainerStarted","Data":"e454a05884c00cb575d34e9333828cde818390fcdb4c7f3eee1eba86ebe22394"}
Jul 17 15:35:52.243003 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:52.242954    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podStartSLOduration=1.242939443 podStartE2EDuration="1.242939443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:35:52.241288152 +0000 UTC m=+2765.439552491" watchObservedRunningTime="2026-07-17 15:35:52.242939443 +0000 UTC m=+2765.441203782"
Jul 17 15:35:52.776683 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:52.776650    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:52.781763 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:52.781741    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:53.220506 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:53.220475    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:53.221421 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:53.221399    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:35:54.231941 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:54.231904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:54.351541 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:54.351501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:54.450308 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:54.450268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:54.683207 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:54.683153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:55.062055 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:55.061941    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:55.163319 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:55.163267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:58.635134 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:35:58.635094    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:01.152907 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.152533    2561 patch_prober.go:28] interesting pod/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:51630->10.132.0.58:15021: read: connection reset by peer" start-of-body=
Jul 17 15:36:01.152907 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.152595    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:51630->10.132.0.58:15021: read: connection reset by peer"
Jul 17 15:36:01.270394 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.270362    2561 generic.go:356] "Generic (PLEG): container finished" podID="e064b16d-0569-4780-9167-370318eb8a3a" containerID="5c26db94d97d0428c3fb13544c30aed14ab90169effeb9ac72499dcc631b06bf" exitCode=0
Jul 17 15:36:01.270516 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.270415    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" event={"ID":"e064b16d-0569-4780-9167-370318eb8a3a","Type":"ContainerDied","Data":"5c26db94d97d0428c3fb13544c30aed14ab90169effeb9ac72499dcc631b06bf"}
Jul 17 15:36:01.270796 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.270782    2561 scope.go:117] "RemoveContainer" containerID="5c26db94d97d0428c3fb13544c30aed14ab90169effeb9ac72499dcc631b06bf"
Jul 17 15:36:01.271774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.271741    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:01.271873 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.271840    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:01.271937 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:01.271895    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:02.277923 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:02.277888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" event={"ID":"e064b16d-0569-4780-9167-370318eb8a3a","Type":"ContainerStarted","Data":"9d293582bd35b1fbccd08842ff9f3f48549f7aba7b35684ee186383228783b13"}
Jul 17 15:36:02.704157 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:02.704119    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:36:02.704398 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:02.704371    2561 patch_prober.go:28] interesting pod/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 17 15:36:02.704477 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:02.704434    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 17 15:36:03.705024 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:03.704981    2561 patch_prober.go:28] interesting pod/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 17 15:36:03.706114 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:03.705641    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 17 15:36:04.704810 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:04.704768    2561 patch_prober.go:28] interesting pod/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 17 15:36:04.705025 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:04.704840    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 17 15:36:05.704890 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:05.704851    2561 patch_prober.go:28] interesting pod/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 17 15:36:05.705531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:05.705496    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 17 15:36:06.709303 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:06.709264    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:36:06.710488 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:06.710468    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:36:06.715465 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:06.715419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:36:07.149792 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:07.149758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:07.247854 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:07.247823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:09.263247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:09.263164    2561 patch_prober.go:28] interesting pod/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 15:36:09.263247 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:09.263225    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 15:36:09.669846 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:09.669804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:09.744328 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:09.744294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:10.324852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:10.324783    2561 generic.go:356] "Generic (PLEG): container finished" podID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerID="014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721" exitCode=0
Jul 17 15:36:10.324852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:10.324835    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" event={"ID":"f9018c7f-e2d0-46b0-b577-133f8d4a366f","Type":"ContainerDied","Data":"014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721"}
Jul 17 15:36:10.325288 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:10.325231    2561 scope.go:117] "RemoveContainer" containerID="014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721"
Jul 17 15:36:10.326244 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:10.326219    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:10.326308 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:10.326296    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:10.326346 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:10.326335    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:11.334553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:11.334516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" event={"ID":"f9018c7f-e2d0-46b0-b577-133f8d4a366f","Type":"ContainerStarted","Data":"c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5"}
Jul 17 15:36:11.776999 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:11.776967    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:36:11.777221 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:11.777159    2561 patch_prober.go:28] interesting pod/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 15:36:11.777221 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:11.777212    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 15:36:12.777404 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:12.777372    2561 patch_prober.go:28] interesting pod/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 15:36:12.777805 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:12.777440    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 15:36:13.776712 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:13.776677    2561 patch_prober.go:28] interesting pod/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 15:36:13.776894 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:13.776736    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 15:36:14.777585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:14.777550    2561 patch_prober.go:28] interesting pod/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 15:36:14.777992 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:14.777616    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 15:36:15.780451 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:15.780415    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:36:15.780885 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:15.780871    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:36:15.781553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:15.781522    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:36:15.939795 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:15.939760    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:16.041731 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:16.041634    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:16.703049 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:16.703014    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:21.704246 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:21.704212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:27.851970 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:27.851930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:27.920128 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:27.920086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:32.366731 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:32.366696    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"]
Jul 17 15:36:32.367208 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:32.366972    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy" containerID="cri-o://9d293582bd35b1fbccd08842ff9f3f48549f7aba7b35684ee186383228783b13" gracePeriod=30
Jul 17 15:36:32.394460 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:32.394422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:32.611183 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:32.611140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:36.713100 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:36.713063    2561 patch_prober.go:28] interesting pod/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 15:36:36.713558 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:36.713122    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 15:36:37.475002 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:37.474975    2561 generic.go:356] "Generic (PLEG): container finished" podID="e064b16d-0569-4780-9167-370318eb8a3a" containerID="9d293582bd35b1fbccd08842ff9f3f48549f7aba7b35684ee186383228783b13" exitCode=0
Jul 17 15:36:37.475141 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:37.475069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" event={"ID":"e064b16d-0569-4780-9167-370318eb8a3a","Type":"ContainerDied","Data":"9d293582bd35b1fbccd08842ff9f3f48549f7aba7b35684ee186383228783b13"}
Jul 17 15:36:37.475141 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:37.475134    2561 scope.go:117] "RemoveContainer" containerID="5c26db94d97d0428c3fb13544c30aed14ab90169effeb9ac72499dcc631b06bf"
Jul 17 15:36:38.031620 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.031594    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:36:38.052052 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052022    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e064b16d-0569-4780-9167-370318eb8a3a-istio-podinfo\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052164 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052094    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e064b16d-0569-4780-9167-370318eb8a3a-istiod-ca-cert\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052164 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052155    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg599\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-kube-api-access-fg599\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052250 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-istio-token\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052250 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052212    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-certs\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052269    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-socket\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052304    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-envoy\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052455 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-credential-socket\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052455 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052379    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-data\") pod \"e064b16d-0569-4780-9167-370318eb8a3a\" (UID: \"e064b16d-0569-4780-9167-370318eb8a3a\") "
Jul 17 15:36:38.052557 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052514    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e064b16d-0569-4780-9167-370318eb8a3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:36:38.052643 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052555    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:36:38.052643 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052572    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:36:38.052766 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052688    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e064b16d-0569-4780-9167-370318eb8a3a-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.052974 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.052794    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:36:38.054581 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.053766    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:36:38.054995 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.054954    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:36:38.055234 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.055194    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:36:38.055454 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.055421    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e064b16d-0569-4780-9167-370318eb8a3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:36:38.056996 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.056977    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-kube-api-access-fg599" (OuterVolumeSpecName: "kube-api-access-fg599") pod "e064b16d-0569-4780-9167-370318eb8a3a" (UID: "e064b16d-0569-4780-9167-370318eb8a3a"). InnerVolumeSpecName "kube-api-access-fg599". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:36:38.153774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153710    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg599\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-kube-api-access-fg599\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.153774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153733    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e064b16d-0569-4780-9167-370318eb8a3a-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.153774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153744    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.153774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153752    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.153774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153759    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.153774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153767    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.153774 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153774    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e064b16d-0569-4780-9167-370318eb8a3a-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.154095 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.153782    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e064b16d-0569-4780-9167-370318eb8a3a-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:36:38.487509 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.483861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn" event={"ID":"e064b16d-0569-4780-9167-370318eb8a3a","Type":"ContainerDied","Data":"75e44d69aba17b557f1db9fd156a2b02992dbabc626a8547096a7c84ffda9fa3"}
Jul 17 15:36:38.487509 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.483970    2561 scope.go:117] "RemoveContainer" containerID="9d293582bd35b1fbccd08842ff9f3f48549f7aba7b35684ee186383228783b13"
Jul 17 15:36:38.487509 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.484184    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"
Jul 17 15:36:38.514650 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.514616    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"]
Jul 17 15:36:38.520949 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:38.520929    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c30485-openshift-default-65645c8d49-h4cgn"]
Jul 17 15:36:39.232598 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:39.232564    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e064b16d-0569-4780-9167-370318eb8a3a" path="/var/lib/kubelet/pods/e064b16d-0569-4780-9167-370318eb8a3a/volumes"
Jul 17 15:36:43.424478 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:43.424417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:47.861594 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:47.861499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:50.098582 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:50.098536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:50.199494 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:50.199461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:54.198715 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:54.198674    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:54.317366 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:54.317335    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:58.508403 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:58.508365    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"]
Jul 17 15:36:58.508876 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:58.508632    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy" containerID="cri-o://c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5" gracePeriod=30
Jul 17 15:36:58.540894 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:58.540862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:58.779728 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:58.779647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:59.107299 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.107204    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:59.405529 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.405494    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"]
Jul 17 15:36:59.405852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.405840    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy"
Jul 17 15:36:59.405899 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.405854    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy"
Jul 17 15:36:59.405899 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.405869    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy"
Jul 17 15:36:59.405899 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.405876    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy"
Jul 17 15:36:59.405992 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.405938    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy"
Jul 17 15:36:59.408830 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.408814    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.411496 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.411476    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c4e0c6-openshift-default-dockercfg-xltjf\""
Jul 17 15:36:59.422166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.422143    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"]
Jul 17 15:36:59.431234 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.431203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:59.531133 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531101    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-socket\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-token\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-envoy\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da81a54e-8147-4441-a6b3-da7377f1dc65-istiod-ca-cert\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-credential-socket\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-podinfo\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpxms\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-kube-api-access-tpxms\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-certs\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.531585 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.531530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-data\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.632622 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-socket\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.632622 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-token\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.632852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-envoy\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.632852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da81a54e-8147-4441-a6b3-da7377f1dc65-istiod-ca-cert\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.632852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-credential-socket\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.632852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-podinfo\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.632852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpxms\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-kube-api-access-tpxms\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.633159 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-certs\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.633159 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.632894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-data\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.633159 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.633017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-socket\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.633325 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.633161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-credential-socket\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.633325 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.633220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-data\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.633426 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.633336    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-certs\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.633623 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.633599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da81a54e-8147-4441-a6b3-da7377f1dc65-istiod-ca-cert\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.635168 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.635144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-envoy\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.635674 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.635647    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-podinfo\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.642740 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.642720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpxms\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-kube-api-access-tpxms\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.642834 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.642771    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-token\") pod \"e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") " pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.649280 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.649253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:59.719858 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.719805    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:36:59.862955 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.862929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"]
Jul 17 15:36:59.863562 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:36:59.863542    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda81a54e_8147_4441_a6b3_da7377f1dc65.slice/crio-35872b0e5fe21ca11c01b191996eed0bda2c8eca6d2c0dc3050679d8e0465bd8 WatchSource:0}: Error finding container 35872b0e5fe21ca11c01b191996eed0bda2c8eca6d2c0dc3050679d8e0465bd8: Status 404 returned error can't find the container with id 35872b0e5fe21ca11c01b191996eed0bda2c8eca6d2c0dc3050679d8e0465bd8
Jul 17 15:36:59.865682 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.865648    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:59.865777 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.865712    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:36:59.865777 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:36:59.865741    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:00.602997 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:00.602957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" event={"ID":"da81a54e-8147-4441-a6b3-da7377f1dc65","Type":"ContainerStarted","Data":"d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d"}
Jul 17 15:37:00.603376 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:00.603013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" event={"ID":"da81a54e-8147-4441-a6b3-da7377f1dc65","Type":"ContainerStarted","Data":"35872b0e5fe21ca11c01b191996eed0bda2c8eca6d2c0dc3050679d8e0465bd8"}
Jul 17 15:37:00.628224 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:00.628179    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podStartSLOduration=1.628163656 podStartE2EDuration="1.628163656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:37:00.627251517 +0000 UTC m=+2833.825515864" watchObservedRunningTime="2026-07-17 15:37:00.628163656 +0000 UTC m=+2833.826427995"
Jul 17 15:37:00.720900 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:00.720875    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:00.725710 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:00.725690    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:00.782721 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:00.782688    2561 patch_prober.go:28] interesting pod/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 15:37:00.782877 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:00.782737    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 15:37:01.609286 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:01.609259    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:01.610304 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:01.610285    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:02.536955 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:02.536902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:02.653694 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:02.653645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:02.724065 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:02.724020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:02.828140 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:02.828035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:03.475949 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.475901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:03.574019 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.573989    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:03.769096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.769069    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:37:03.873224 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873194    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-podinfo\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873376 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-token\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873376 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873264    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istiod-ca-cert\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873376 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873347    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-socket\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873410    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xmck\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-kube-api-access-8xmck\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873435    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-credential-socket\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873461    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-data\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873505 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873489    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-certs\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873708 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873523    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-envoy\") pod \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\" (UID: \"f9018c7f-e2d0-46b0-b577-133f8d4a366f\") "
Jul 17 15:37:03.873708 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873638    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:37:03.873825 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873738    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:37:03.873902 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873872    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.873902 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873884    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:37:03.874024 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.873985    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:37:03.874410 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.874376    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:37:03.875832 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.875806    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-kube-api-access-8xmck" (OuterVolumeSpecName: "kube-api-access-8xmck") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "kube-api-access-8xmck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:37:03.875917 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.875829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:37:03.876211 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.876189    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:37:03.876274 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.876235    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9018c7f-e2d0-46b0-b577-133f8d4a366f" (UID: "f9018c7f-e2d0-46b0-b577-133f8d4a366f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:37:03.974561 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974525    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xmck\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-kube-api-access-8xmck\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.974561 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974555    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.974561 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974566    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.974785 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974578    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.974785 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974586    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.974785 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974593    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.974785 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974600    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:03.974785 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:03.974608    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9018c7f-e2d0-46b0-b577-133f8d4a366f-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:37:04.627960 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.627926    2561 generic.go:356] "Generic (PLEG): container finished" podID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerID="c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5" exitCode=0
Jul 17 15:37:04.628166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.627968    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"
Jul 17 15:37:04.628166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.628017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" event={"ID":"f9018c7f-e2d0-46b0-b577-133f8d4a366f","Type":"ContainerDied","Data":"c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5"}
Jul 17 15:37:04.628166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.628104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv" event={"ID":"f9018c7f-e2d0-46b0-b577-133f8d4a366f","Type":"ContainerDied","Data":"e454a05884c00cb575d34e9333828cde818390fcdb4c7f3eee1eba86ebe22394"}
Jul 17 15:37:04.628166 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.628136    2561 scope.go:117] "RemoveContainer" containerID="c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5"
Jul 17 15:37:04.638348 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.638317    2561 scope.go:117] "RemoveContainer" containerID="014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721"
Jul 17 15:37:04.646302 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.646288    2561 scope.go:117] "RemoveContainer" containerID="c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5"
Jul 17 15:37:04.646563 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:37:04.646545    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5\": container with ID starting with c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5 not found: ID does not exist" containerID="c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5"
Jul 17 15:37:04.646614 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.646572    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5"} err="failed to get container status \"c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5\": rpc error: code = NotFound desc = could not find container \"c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5\": container with ID starting with c44d94e15c39d1e568c19070e2ea6f74c8e6ae851dc9c26928e6283e1d67b3d5 not found: ID does not exist"
Jul 17 15:37:04.646614 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.646589    2561 scope.go:117] "RemoveContainer" containerID="014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721"
Jul 17 15:37:04.646838 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:37:04.646824    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721\": container with ID starting with 014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721 not found: ID does not exist" containerID="014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721"
Jul 17 15:37:04.646875 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.646844    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721"} err="failed to get container status \"014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721\": rpc error: code = NotFound desc = could not find container \"014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721\": container with ID starting with 014b8cdb7a22b4b86ab667d3949d17cb74b4e97624bd8c57c9763731bea0e721 not found: ID does not exist"
Jul 17 15:37:04.653244 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.653221    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"]
Jul 17 15:37:04.657437 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:04.657416    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-818628-openshift-default-64df8f48c-nbjjv"]
Jul 17 15:37:05.232002 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:05.231973    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" path="/var/lib/kubelet/pods/f9018c7f-e2d0-46b0-b577-133f8d4a366f/volumes"
Jul 17 15:37:07.014306 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.014264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:07.341978 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.341942    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:07.608088 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.607994    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"]
Jul 17 15:37:07.608416 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.608400    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy"
Jul 17 15:37:07.608416 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.608416    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy"
Jul 17 15:37:07.608531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.608426    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy"
Jul 17 15:37:07.608531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.608431    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy"
Jul 17 15:37:07.608531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.608484    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy"
Jul 17 15:37:07.608531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.608492    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e064b16d-0569-4780-9167-370318eb8a3a" containerName="istio-proxy"
Jul 17 15:37:07.608531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.608499    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9018c7f-e2d0-46b0-b577-133f8d4a366f" containerName="istio-proxy"
Jul 17 15:37:07.612883 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.612859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.615229 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.615213    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ae3cc1-openshift-default-dockercfg-vrx5z\""
Jul 17 15:37:07.630703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.630673    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"]
Jul 17 15:37:07.637471 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.637437    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:07.708199 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-data\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708415 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-credential-socket\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708415 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-podinfo\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708415 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhz2k\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-kube-api-access-mhz2k\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708415 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-envoy\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708415 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-socket\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708706 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aec423e-e498-4092-bf83-1b01b2fc1e16-istiod-ca-cert\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708706 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-certs\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.708706 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.708476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-token\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809236 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-socket\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aec423e-e498-4092-bf83-1b01b2fc1e16-istiod-ca-cert\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-certs\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-token\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-data\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-credential-socket\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-podinfo\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809688 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhz2k\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-kube-api-access-mhz2k\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809688 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-envoy\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809688 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-certs\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809688 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-socket\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809864 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-credential-socket\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.809906 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.809875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-data\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.810121 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.810104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aec423e-e498-4092-bf83-1b01b2fc1e16-istiod-ca-cert\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.812032 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.812009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-envoy\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.812213 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.812195    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-podinfo\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.819002 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.818975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-token\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.819182 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.819166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhz2k\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-kube-api-access-mhz2k\") pod \"e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") " pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:07.879355 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.879317    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:07.924365 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:07.924338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:08.071006 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.070975    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"]
Jul 17 15:37:08.072124 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:37:08.072100    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aec423e_e498_4092_bf83_1b01b2fc1e16.slice/crio-21f3546ffaae837c13c145ceec9e1a433d7d49969c46d861f4a7e5daef920384 WatchSource:0}: Error finding container 21f3546ffaae837c13c145ceec9e1a433d7d49969c46d861f4a7e5daef920384: Status 404 returned error can't find the container with id 21f3546ffaae837c13c145ceec9e1a433d7d49969c46d861f4a7e5daef920384
Jul 17 15:37:08.074301 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.074268    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:08.074369 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.074334    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:08.074369 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.074363    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:08.654477 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.654440    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" event={"ID":"9aec423e-e498-4092-bf83-1b01b2fc1e16","Type":"ContainerStarted","Data":"4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9"}
Jul 17 15:37:08.654650 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.654507    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" event={"ID":"9aec423e-e498-4092-bf83-1b01b2fc1e16","Type":"ContainerStarted","Data":"21f3546ffaae837c13c145ceec9e1a433d7d49969c46d861f4a7e5daef920384"}
Jul 17 15:37:08.680520 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.680468    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" podStartSLOduration=1.680453575 podStartE2EDuration="1.680453575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:37:08.678604938 +0000 UTC m=+2841.876869277" watchObservedRunningTime="2026-07-17 15:37:08.680453575 +0000 UTC m=+2841.878717914"
Jul 17 15:37:08.925198 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:08.925103    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:09.932163 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:09.932132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:10.618235 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:10.618201    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:10.665323 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:10.665290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:10.666345 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:10.666324    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:10.719096 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:10.719061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:10.861199 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:10.861157    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:10.958936 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:10.958901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:11.744820 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:11.744786    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:11.842754 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:11.842714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:15.069835 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:15.069799    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:16.610718 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.610637    2561 patch_prober.go:28] interesting pod/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 17 15:37:16.610718 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.610686    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 17 15:37:16.702372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.702341    2561 generic.go:356] "Generic (PLEG): container finished" podID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerID="d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d" exitCode=0
Jul 17 15:37:16.702529 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.702397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" event={"ID":"da81a54e-8147-4441-a6b3-da7377f1dc65","Type":"ContainerDied","Data":"d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d"}
Jul 17 15:37:16.702766 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.702752    2561 scope.go:117] "RemoveContainer" containerID="d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d"
Jul 17 15:37:16.703746 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.703718    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:16.703809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.703795    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:16.703889 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:16.703827    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:17.711922 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:17.711887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" event={"ID":"da81a54e-8147-4441-a6b3-da7377f1dc65","Type":"ContainerStarted","Data":"b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44"}
Jul 17 15:37:17.720285 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:17.720249    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:17.721080 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:17.721011    2561 patch_prober.go:28] interesting pod/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 17 15:37:17.721222 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:17.721094    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 17 15:37:18.721130 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:18.721096    2561 patch_prober.go:28] interesting pod/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 17 15:37:18.721724 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:18.721693    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 17 15:37:19.732809 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:19.732766    2561 patch_prober.go:28] interesting pod/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 17 15:37:19.733353 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:19.732835    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 17 15:37:20.720808 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:20.720764    2561 patch_prober.go:28] interesting pod/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 17 15:37:20.721024 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:20.720835    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 17 15:37:21.720278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:21.720238    2561 patch_prober.go:28] interesting pod/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 17 15:37:21.720733 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:21.720303    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 17 15:37:22.724434 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:22.724398    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:22.724925 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:22.724680    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:22.725374 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:22.725356    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:37:24.335759 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.335723    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:24.441180 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.441140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:24.765161 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.765129    2561 generic.go:356] "Generic (PLEG): container finished" podID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerID="4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9" exitCode=0
Jul 17 15:37:24.765328 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.765206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" event={"ID":"9aec423e-e498-4092-bf83-1b01b2fc1e16","Type":"ContainerDied","Data":"4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9"}
Jul 17 15:37:24.765613 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.765596    2561 scope.go:117] "RemoveContainer" containerID="4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9"
Jul 17 15:37:24.766662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.766634    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:24.766740 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.766704    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:24.766740 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:24.766735    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 17 15:37:25.665329 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:25.665293    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:25.772325 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:25.772292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" event={"ID":"9aec423e-e498-4092-bf83-1b01b2fc1e16","Type":"ContainerStarted","Data":"a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4"}
Jul 17 15:37:25.925431 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:25.925321    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:25.926814 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:25.926779    2561 patch_prober.go:28] interesting pod/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 17 15:37:25.926949 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:25.926846    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 17 15:37:26.925694 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:26.925650    2561 patch_prober.go:28] interesting pod/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 17 15:37:26.926208 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:26.925715    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 17 15:37:27.925486 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:27.925439    2561 patch_prober.go:28] interesting pod/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 17 15:37:27.925705 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:27.925517    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 17 15:37:28.603996 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:28.603960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:28.925341 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:28.925258    2561 patch_prober.go:28] interesting pod/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 17 15:37:28.925341 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:28.925321    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 17 15:37:29.928874 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:29.928846    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:29.929302 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:29.929148    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:29.929762 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:29.929743    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:37:32.869270 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:32.869230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:32.969551 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:32.969513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:42.832527 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:37:42.832446    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:21.157173 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:39:21.157084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:34.074443 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:39:34.074406    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:47.460461 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:39:47.460438    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:39:47.468525 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:39:47.468504    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sppht_119823c3-d23a-4430-bf25-b43af13da224/kube-multus/0.log"
Jul 17 15:39:58.781303 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:39:58.781239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:59.592877 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:39:59.592839    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:40:13.823501 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:40:13.823470    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:40:30.935397 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:40:30.935357    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:11.912139 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:41:11.912095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:12.719122 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:41:12.719085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:19.664345 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:41:19.664305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:44.716947 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:41:44.716907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:51.009128 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:41:51.009089    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:51.118389 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:41:51.118347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:56.746821 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:41:56.746776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:25.272504 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:25.272461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:25.372593 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:25.372546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:33.768642 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:33.768590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:33.869499 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:33.869459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:38.711697 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:38.711661    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:39.580844 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:39.580804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:59.882124 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:59.882063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:59.982872 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:42:59.982841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:09.625978 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:09.625928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:14.206883 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:14.206831    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:15.402849 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:15.402810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:15.462237 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:15.462203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:20.476224 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:20.476182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:20.576302 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:20.576268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:24.866278 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:24.866245    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"]
Jul 17 15:43:24.866731 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:24.866494    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy" containerID="cri-o://b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44" gracePeriod=30
Jul 17 15:43:24.882491 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:24.882464    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:25.121817 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:25.121729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:26.064777 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:26.064738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:26.164848 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:26.164813    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:30.121016 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.120994    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:43:30.192150 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192079    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da81a54e-8147-4441-a6b3-da7377f1dc65-istiod-ca-cert\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192150 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192130    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-certs\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192150 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192146    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-data\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192367 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpxms\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-kube-api-access-tpxms\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192367 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192189    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-envoy\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192367 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192208    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-token\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192367 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192261    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-socket\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192367 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-credential-socket\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192367 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192337    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-podinfo\") pod \"da81a54e-8147-4441-a6b3-da7377f1dc65\" (UID: \"da81a54e-8147-4441-a6b3-da7377f1dc65\") "
Jul 17 15:43:30.192656 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192384    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:30.192656 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192570    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:30.192656 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192597    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:30.192656 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192624    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da81a54e-8147-4441-a6b3-da7377f1dc65-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:43:30.192869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192705    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.192869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192723    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.192869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192737    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.192869 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.192752    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da81a54e-8147-4441-a6b3-da7377f1dc65-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.193285 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.193000    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-data" (OuterVolumeSpecName: "istio-data") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:30.194614 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.194589    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-kube-api-access-tpxms" (OuterVolumeSpecName: "kube-api-access-tpxms") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "kube-api-access-tpxms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:43:30.194614 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.194606    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:30.194800 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.194702    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-token" (OuterVolumeSpecName: "istio-token") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:43:30.194868 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.194854    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "da81a54e-8147-4441-a6b3-da7377f1dc65" (UID: "da81a54e-8147-4441-a6b3-da7377f1dc65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:43:30.294120 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.294100    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.294120 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.294120    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpxms\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-kube-api-access-tpxms\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.294274 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.294130    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.294274 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.294138    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.294274 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.294145    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da81a54e-8147-4441-a6b3-da7377f1dc65-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:30.715789 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.715757    2561 generic.go:356] "Generic (PLEG): container finished" podID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerID="b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44" exitCode=0
Jul 17 15:43:30.715942 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.715801    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"
Jul 17 15:43:30.715942 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.715827    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" event={"ID":"da81a54e-8147-4441-a6b3-da7377f1dc65","Type":"ContainerDied","Data":"b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44"}
Jul 17 15:43:30.715942 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.715876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7" event={"ID":"da81a54e-8147-4441-a6b3-da7377f1dc65","Type":"ContainerDied","Data":"35872b0e5fe21ca11c01b191996eed0bda2c8eca6d2c0dc3050679d8e0465bd8"}
Jul 17 15:43:30.715942 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.715913    2561 scope.go:117] "RemoveContainer" containerID="b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44"
Jul 17 15:43:30.725798 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.725781    2561 scope.go:117] "RemoveContainer" containerID="d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d"
Jul 17 15:43:30.734318 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.734297    2561 scope.go:117] "RemoveContainer" containerID="b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44"
Jul 17 15:43:30.734580 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:43:30.734546    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44\": container with ID starting with b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44 not found: ID does not exist" containerID="b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44"
Jul 17 15:43:30.734634 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.734586    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44"} err="failed to get container status \"b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44\": rpc error: code = NotFound desc = could not find container \"b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44\": container with ID starting with b8c0007aeeb4e609a2a007d6c9de7ca61dc9a1d52b3ef7fd7c7a463bc4579e44 not found: ID does not exist"
Jul 17 15:43:30.734634 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.734604    2561 scope.go:117] "RemoveContainer" containerID="d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d"
Jul 17 15:43:30.734794 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:43:30.734780    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d\": container with ID starting with d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d not found: ID does not exist" containerID="d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d"
Jul 17 15:43:30.734839 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.734796    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d"} err="failed to get container status \"d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d\": rpc error: code = NotFound desc = could not find container \"d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d\": container with ID starting with d1943b655be4df2b1fc39deffdc1bace9545b6460387c1bee28864646f925c8d not found: ID does not exist"
Jul 17 15:43:30.741243 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.741221    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"]
Jul 17 15:43:30.745496 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:30.745476    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c4e0c6-openshift-default-6c56757dc-zrpq7"]
Jul 17 15:43:31.233180 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:31.233151    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" path="/var/lib/kubelet/pods/da81a54e-8147-4441-a6b3-da7377f1dc65/volumes"
Jul 17 15:43:35.772487 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:35.772456    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:40.350416 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:40.350305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:46.847501 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:46.847463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:46.947312 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:46.947278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:50.997099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:50.997066    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"]
Jul 17 15:43:50.997565 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:50.997269    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy" containerID="cri-o://a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4" gracePeriod=30
Jul 17 15:43:51.007317 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:51.007287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:51.230170 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:51.230136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:56.248169 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.248146    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:43:56.403455 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403426    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-certs\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403608 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403466    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-podinfo\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403608 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhz2k\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-kube-api-access-mhz2k\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403608 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403529    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-socket\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403608 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403559    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-data\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403608 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403605    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-envoy\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403864 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403647    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-token\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403864 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403659    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:56.403864 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403672    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aec423e-e498-4092-bf83-1b01b2fc1e16-istiod-ca-cert\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.403864 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-credential-socket\") pod \"9aec423e-e498-4092-bf83-1b01b2fc1e16\" (UID: \"9aec423e-e498-4092-bf83-1b01b2fc1e16\") "
Jul 17 15:43:56.404099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403886    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:56.404099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.404065    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-certs\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.404099 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.404086    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-workload-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.404252 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.404098    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:56.404252 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.403991    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aec423e-e498-4092-bf83-1b01b2fc1e16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:43:56.404701 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.404669    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-data" (OuterVolumeSpecName: "istio-data") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:56.405852 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.405827    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 15:43:56.405947 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.405894    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-kube-api-access-mhz2k" (OuterVolumeSpecName: "kube-api-access-mhz2k") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "kube-api-access-mhz2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:43:56.405947 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.405933    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-token" (OuterVolumeSpecName: "istio-token") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:43:56.406340 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.406324    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9aec423e-e498-4092-bf83-1b01b2fc1e16" (UID: "9aec423e-e498-4092-bf83-1b01b2fc1e16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:43:56.504877 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.504843    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-podinfo\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.504877 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.504875    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhz2k\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-kube-api-access-mhz2k\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.504877 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.504886    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-data\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.505072 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.504895    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-envoy\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.505072 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.504902    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9aec423e-e498-4092-bf83-1b01b2fc1e16-istio-token\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.505072 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.504909    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9aec423e-e498-4092-bf83-1b01b2fc1e16-istiod-ca-cert\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.505072 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.504917    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9aec423e-e498-4092-bf83-1b01b2fc1e16-credential-socket\") on node \"ip-10-0-143-54.ec2.internal\" DevicePath \"\""
Jul 17 15:43:56.860433 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.860349    2561 generic.go:356] "Generic (PLEG): container finished" podID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerID="a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4" exitCode=0
Jul 17 15:43:56.860433 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.860417    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"
Jul 17 15:43:56.860667 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.860438    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" event={"ID":"9aec423e-e498-4092-bf83-1b01b2fc1e16","Type":"ContainerDied","Data":"a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4"}
Jul 17 15:43:56.860667 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.860504    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk" event={"ID":"9aec423e-e498-4092-bf83-1b01b2fc1e16","Type":"ContainerDied","Data":"21f3546ffaae837c13c145ceec9e1a433d7d49969c46d861f4a7e5daef920384"}
Jul 17 15:43:56.860667 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.860539    2561 scope.go:117] "RemoveContainer" containerID="a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4"
Jul 17 15:43:56.869966 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.869949    2561 scope.go:117] "RemoveContainer" containerID="4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9"
Jul 17 15:43:56.877942 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.877925    2561 scope.go:117] "RemoveContainer" containerID="a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4"
Jul 17 15:43:56.878213 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:43:56.878196    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4\": container with ID starting with a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4 not found: ID does not exist" containerID="a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4"
Jul 17 15:43:56.878266 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.878221    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4"} err="failed to get container status \"a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4\": rpc error: code = NotFound desc = could not find container \"a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4\": container with ID starting with a7dd77a5de0c5e2f3cd155a386429ea2ce7c253aabe98afb64f5e45fda5926b4 not found: ID does not exist"
Jul 17 15:43:56.878266 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.878239    2561 scope.go:117] "RemoveContainer" containerID="4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9"
Jul 17 15:43:56.878487 ip-10-0-143-54 kubenswrapper[2561]: E0717 15:43:56.878469    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9\": container with ID starting with 4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9 not found: ID does not exist" containerID="4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9"
Jul 17 15:43:56.878540 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.878492    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9"} err="failed to get container status \"4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9\": rpc error: code = NotFound desc = could not find container \"4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9\": container with ID starting with 4fc5774c4b43114df28cf80ec5153bdf4c4289943b4af687132e20a0f0e175e9 not found: ID does not exist"
Jul 17 15:43:56.885739 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.885717    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"]
Jul 17 15:43:56.889504 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:56.889485    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ae3cc1-openshift-default-6967888f8c-bj5hk"]
Jul 17 15:43:57.241220 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:57.241180    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" path="/var/lib/kubelet/pods/9aec423e-e498-4092-bf83-1b01b2fc1e16/volumes"
Jul 17 15:43:57.253163 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:57.253139    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9db8d9bf9-lnc2w_200e6c6d-4a4d-46eb-9d3f-4c8ba3016491/manager/0.log"
Jul 17 15:43:57.822898 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:57.822870    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-kcbvh_edc1644f-752b-40e1-856e-8ba454b1cdae/copy-manifests/0.log"
Jul 17 15:43:57.830648 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:57.830624    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-kcbvh_edc1644f-752b-40e1-856e-8ba454b1cdae/manager/0.log"
Jul 17 15:43:58.192106 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:58.192082    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-64bf799b45-pzcbw_b0c42513-faf7-4235-934e-d45362d296d4/maas-api/0.log"
Jul 17 15:43:59.372407 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:43:59.372375    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-45tx5_c7c33764-178f-475b-93b2-36816d4eeda6/postgres/0.log"
Jul 17 15:44:00.130218 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.130192    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz_18a87401-b531-47bf-a6c6-c427b10637e1/util/0.log"
Jul 17 15:44:00.137372 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.137348    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz_18a87401-b531-47bf-a6c6-c427b10637e1/pull/0.log"
Jul 17 15:44:00.144296 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.144263    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz_18a87401-b531-47bf-a6c6-c427b10637e1/extract/0.log"
Jul 17 15:44:00.253318 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.253293    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn_f13333ff-6c80-4fd4-bddf-e128a165a4c2/util/0.log"
Jul 17 15:44:00.259938 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.259918    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn_f13333ff-6c80-4fd4-bddf-e128a165a4c2/pull/0.log"
Jul 17 15:44:00.266842 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.266822    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn_f13333ff-6c80-4fd4-bddf-e128a165a4c2/extract/0.log"
Jul 17 15:44:00.376005 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.375986    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb_cb616fc8-ab5f-41da-bd99-b716d83de0f8/util/0.log"
Jul 17 15:44:00.383343 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.383289    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb_cb616fc8-ab5f-41da-bd99-b716d83de0f8/pull/0.log"
Jul 17 15:44:00.390721 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.390696    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb_cb616fc8-ab5f-41da-bd99-b716d83de0f8/extract/0.log"
Jul 17 15:44:00.497415 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.497392    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5_29b49be0-9017-4cd3-a570-edc34a822ac7/pull/0.log"
Jul 17 15:44:00.503983 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.503967    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5_29b49be0-9017-4cd3-a570-edc34a822ac7/extract/0.log"
Jul 17 15:44:00.510511 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:00.510491    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5_29b49be0-9017-4cd3-a570-edc34a822ac7/util/0.log"
Jul 17 15:44:01.863550 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:01.863503    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnctx_2cfad67b-d668-4b48-81b1-2aeae605e7d1/discovery/0.log"
Jul 17 15:44:02.315675 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:02.315643    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-pttbc_7fe84b9f-0b0a-46bc-b10a-15671c6b6f87/payload-pre-processing/0.log"
Jul 17 15:44:02.430060 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:02.430020    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-phxp8_3d00bdc0-a115-44e1-ae0c-f19613d67607/payload-processing/0.log"
Jul 17 15:44:02.860360 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:02.860328    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vslt7_689ae9a7-6196-4f53-aa9b-adef744e38fc/main/0.log"
Jul 17 15:44:03.290583 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:03.290554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qlb5v_a35984b3-b4b9-444c-a721-914d126f7063/main/0.log"
Jul 17 15:44:08.599855 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:08.599821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:08.699935 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:08.699902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:11.417272 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:11.417238    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dwst6_593de47b-3614-4449-9ccb-a4b5343620a8/global-pull-secret-syncer/0.log"
Jul 17 15:44:11.486022 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:11.485991    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log"
Jul 17 15:44:11.638731 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:11.638703    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-54.ec2.internal_77a81f731c7bc318ff3a837aa25ff363/haproxy/0.log"
Jul 17 15:44:16.443513 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.443484    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz_18a87401-b531-47bf-a6c6-c427b10637e1/extract/0.log"
Jul 17 15:44:16.468887 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.468864    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz_18a87401-b531-47bf-a6c6-c427b10637e1/util/0.log"
Jul 17 15:44:16.495842 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.495817    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75978vcz_18a87401-b531-47bf-a6c6-c427b10637e1/pull/0.log"
Jul 17 15:44:16.525858 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.525837    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn_f13333ff-6c80-4fd4-bddf-e128a165a4c2/extract/0.log"
Jul 17 15:44:16.549206 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.549185    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn_f13333ff-6c80-4fd4-bddf-e128a165a4c2/util/0.log"
Jul 17 15:44:16.572838 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.572817    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dgpfn_f13333ff-6c80-4fd4-bddf-e128a165a4c2/pull/0.log"
Jul 17 15:44:16.602234 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.602211    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb_cb616fc8-ab5f-41da-bd99-b716d83de0f8/extract/0.log"
Jul 17 15:44:16.630710 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.630684    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb_cb616fc8-ab5f-41da-bd99-b716d83de0f8/util/0.log"
Jul 17 15:44:16.655491 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.655469    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73dfcvb_cb616fc8-ab5f-41da-bd99-b716d83de0f8/pull/0.log"
Jul 17 15:44:16.689571 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.689547    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5_29b49be0-9017-4cd3-a570-edc34a822ac7/extract/0.log"
Jul 17 15:44:16.720749 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.720693    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5_29b49be0-9017-4cd3-a570-edc34a822ac7/util/0.log"
Jul 17 15:44:16.745192 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:16.745172    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef172cg5_29b49be0-9017-4cd3-a570-edc34a822ac7/pull/0.log"
Jul 17 15:44:19.164260 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.164229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2184647-a2d4-493d-b7a9-582ee94b0ec9/alertmanager/0.log"
Jul 17 15:44:19.194457 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.194418    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2184647-a2d4-493d-b7a9-582ee94b0ec9/config-reloader/0.log"
Jul 17 15:44:19.221273 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.221250    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2184647-a2d4-493d-b7a9-582ee94b0ec9/kube-rbac-proxy-web/0.log"
Jul 17 15:44:19.247518 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.247499    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2184647-a2d4-493d-b7a9-582ee94b0ec9/kube-rbac-proxy/0.log"
Jul 17 15:44:19.281340 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.281307    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2184647-a2d4-493d-b7a9-582ee94b0ec9/kube-rbac-proxy-metric/0.log"
Jul 17 15:44:19.306514 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.306493    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2184647-a2d4-493d-b7a9-582ee94b0ec9/prom-label-proxy/0.log"
Jul 17 15:44:19.332553 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.332532    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e2184647-a2d4-493d-b7a9-582ee94b0ec9/init-config-reloader/0.log"
Jul 17 15:44:19.422672 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.422608    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8nzwr_6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c/kube-state-metrics/0.log"
Jul 17 15:44:19.462314 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.462298    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8nzwr_6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c/kube-rbac-proxy-main/0.log"
Jul 17 15:44:19.508330 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.508290    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8nzwr_6e5bd6e4-fbc0-4d03-84e2-3ba879f5751c/kube-rbac-proxy-self/0.log"
Jul 17 15:44:19.557495 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.557477    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7ddcd7db6b-q5vj5_1a15197e-f4e4-4893-ab27-8d2c8dd2d366/metrics-server/0.log"
Jul 17 15:44:19.691460 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.691396    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wgkr_5df2e55b-b7fe-48df-8eaa-90bcdf94dabd/node-exporter/0.log"
Jul 17 15:44:19.725698 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.725676    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wgkr_5df2e55b-b7fe-48df-8eaa-90bcdf94dabd/kube-rbac-proxy/0.log"
Jul 17 15:44:19.757744 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:19.757726    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6wgkr_5df2e55b-b7fe-48df-8eaa-90bcdf94dabd/init-textfile/0.log"
Jul 17 15:44:20.270104 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:20.269976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-66clz_3a2067a1-9fe3-438d-9eb4-1989f8a1020b/prometheus-operator/0.log"
Jul 17 15:44:20.291001 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:20.290976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-66clz_3a2067a1-9fe3-438d-9eb4-1989f8a1020b/kube-rbac-proxy/0.log"
Jul 17 15:44:20.319284 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:20.319266    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-x5vs5_250750ee-675c-4c0b-88f1-3af126e658a3/prometheus-operator-admission-webhook/0.log"
Jul 17 15:44:20.348216 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:20.348198    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c995f487c-t5mmk_f6bc90b9-7dc2-490e-81a9-ebb82289edb2/telemeter-client/0.log"
Jul 17 15:44:20.371531 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:20.371512    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c995f487c-t5mmk_f6bc90b9-7dc2-490e-81a9-ebb82289edb2/reload/0.log"
Jul 17 15:44:20.395966 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:20.395951    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c995f487c-t5mmk_f6bc90b9-7dc2-490e-81a9-ebb82289edb2/kube-rbac-proxy/0.log"
Jul 17 15:44:21.584067 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584021    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"]
Jul 17 15:44:21.584567 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584551    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy"
Jul 17 15:44:21.584662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584571    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy"
Jul 17 15:44:21.584662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584602    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy"
Jul 17 15:44:21.584662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584612    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy"
Jul 17 15:44:21.584662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584622    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy"
Jul 17 15:44:21.584662 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584629    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy"
Jul 17 15:44:21.584924 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584742    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy"
Jul 17 15:44:21.584924 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584754    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aec423e-e498-4092-bf83-1b01b2fc1e16" containerName="istio-proxy"
Jul 17 15:44:21.584924 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.584766    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="da81a54e-8147-4441-a6b3-da7377f1dc65" containerName="istio-proxy"
Jul 17 15:44:21.588195 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.588181    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.590870 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.590848    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rfwj\"/\"kube-root-ca.crt\""
Jul 17 15:44:21.590998 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.590848    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rfwj\"/\"openshift-service-ca.crt\""
Jul 17 15:44:21.590998 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.590899    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8rfwj\"/\"default-dockercfg-q4hr6\""
Jul 17 15:44:21.599334 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.599303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"]
Jul 17 15:44:21.613377 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.613353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-proc\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.613469 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.613392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-sys\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.613469 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.613453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-podres\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.613560 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.613470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-lib-modules\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.613560 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.613492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zdrm\" (UniqueName: \"kubernetes.io/projected/263846a7-7eda-4570-807f-17e22b1d603a-kube-api-access-4zdrm\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714580 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-proc\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-sys\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-podres\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714666    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-proc\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714703 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-lib-modules\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714909 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zdrm\" (UniqueName: \"kubernetes.io/projected/263846a7-7eda-4570-807f-17e22b1d603a-kube-api-access-4zdrm\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714909 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-sys\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714909 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714765    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-podres\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.714909 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.714876    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/263846a7-7eda-4570-807f-17e22b1d603a-lib-modules\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.724664 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.724640    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zdrm\" (UniqueName: \"kubernetes.io/projected/263846a7-7eda-4570-807f-17e22b1d603a-kube-api-access-4zdrm\") pod \"perf-node-gather-daemonset-pk7lg\" (UID: \"263846a7-7eda-4570-807f-17e22b1d603a\") " pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:21.905573 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:21.905542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:22.045277 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:22.045246    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"]
Jul 17 15:44:22.047026 ip-10-0-143-54 kubenswrapper[2561]: W0717 15:44:22.046998    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod263846a7_7eda_4570_807f_17e22b1d603a.slice/crio-1125b1e423d4112e7870d3a6a0dffaadbf466c4c78e1d0195e0c2253fec905a3 WatchSource:0}: Error finding container 1125b1e423d4112e7870d3a6a0dffaadbf466c4c78e1d0195e0c2253fec905a3: Status 404 returned error can't find the container with id 1125b1e423d4112e7870d3a6a0dffaadbf466c4c78e1d0195e0c2253fec905a3
Jul 17 15:44:22.849526 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:22.849494    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6647f6578f-4mpgj_b4af955c-4a3f-4631-8b7f-c714a652b9a4/console/0.log"
Jul 17 15:44:23.004625 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:23.004591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg" event={"ID":"263846a7-7eda-4570-807f-17e22b1d603a","Type":"ContainerStarted","Data":"4ecf36aae8501588213aa36d934bd2a51ff735458d6fef9b8f7c0011d5dcd565"}
Jul 17 15:44:23.004811 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:23.004639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg" event={"ID":"263846a7-7eda-4570-807f-17e22b1d603a","Type":"ContainerStarted","Data":"1125b1e423d4112e7870d3a6a0dffaadbf466c4c78e1d0195e0c2253fec905a3"}
Jul 17 15:44:23.004811 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:23.004674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:23.023717 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:23.023675    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg" podStartSLOduration=2.023660845 podStartE2EDuration="2.023660845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:44:23.022162032 +0000 UTC m=+3276.220426370" watchObservedRunningTime="2026-07-17 15:44:23.023660845 +0000 UTC m=+3276.221925183"
Jul 17 15:44:24.622140 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:24.622111    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr5qp_29aa64f3-12a0-4ee6-8135-608dfe4baf1f/dns/0.log"
Jul 17 15:44:24.645963 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:24.645942    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sr5qp_29aa64f3-12a0-4ee6-8135-608dfe4baf1f/kube-rbac-proxy/0.log"
Jul 17 15:44:24.755550 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:24.755524    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9zk4_3a7966eb-275b-4b12-b0bd-5b15749728df/dns-node-resolver/0.log"
Jul 17 15:44:25.450592 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:25.450558    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xsllf_5e27ec93-6172-4179-9dfa-0f23b6ee274d/node-ca/0.log"
Jul 17 15:44:26.645160 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:26.645126    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnctx_2cfad67b-d668-4b48-81b1-2aeae605e7d1/discovery/0.log"
Jul 17 15:44:26.808017 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:26.807990    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-pttbc_7fe84b9f-0b0a-46bc-b10a-15671c6b6f87/payload-pre-processing/0.log"
Jul 17 15:44:26.844841 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:26.844815    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-phxp8_3d00bdc0-a115-44e1-ae0c-f19613d67607/payload-processing/0.log"
Jul 17 15:44:27.641009 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:27.640968    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vd75z_2df39284-4e0b-4963-8975-e5343be7e400/serve-healthcheck-canary/0.log"
Jul 17 15:44:28.335945 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:28.335900    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zqn8g_595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4/kube-rbac-proxy/0.log"
Jul 17 15:44:28.359682 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:28.359657    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zqn8g_595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4/exporter/0.log"
Jul 17 15:44:28.384676 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:28.384653    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zqn8g_595b8b32-e1ba-4d36-a8b9-e1da0d91d7f4/extractor/0.log"
Jul 17 15:44:29.021135 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:29.021110    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8rfwj/perf-node-gather-daemonset-pk7lg"
Jul 17 15:44:31.048760 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:31.048733    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9db8d9bf9-lnc2w_200e6c6d-4a4d-46eb-9d3f-4c8ba3016491/manager/0.log"
Jul 17 15:44:31.341928 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:31.341896    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-kcbvh_edc1644f-752b-40e1-856e-8ba454b1cdae/manager/0.log"
Jul 17 15:44:31.371143 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:31.371119    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dcf5668f8-kcbvh_edc1644f-752b-40e1-856e-8ba454b1cdae/copy-manifests/0.log"
Jul 17 15:44:32.615381 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:32.615350    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnctx_2cfad67b-d668-4b48-81b1-2aeae605e7d1/discovery/0.log"
Jul 17 15:44:32.681914 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:32.681880    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9db68d568-nf4x7_7e9bb061-1db1-4f59-9145-596b7cfe291c/manager/0.log"
Jul 17 15:44:32.712845 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:32.712754    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nsdq5_a910faa5-adc3-4950-a35e-ed0bfd4e5810/openshift-lws-operator/0.log"
Jul 17 15:44:32.743380 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:32.743336    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-pttbc_7fe84b9f-0b0a-46bc-b10a-15671c6b6f87/payload-pre-processing/0.log"
Jul 17 15:44:32.772892 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:32.772845    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-phxp8_3d00bdc0-a115-44e1-ae0c-f19613d67607/payload-processing/0.log"
Jul 17 15:44:34.276086 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:34.276051    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nnctx_2cfad67b-d668-4b48-81b1-2aeae605e7d1/discovery/0.log"
Jul 17 15:44:34.394935 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:34.394910    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-pttbc_7fe84b9f-0b0a-46bc-b10a-15671c6b6f87/payload-pre-processing/0.log"
Jul 17 15:44:34.429198 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:34.429171    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-phxp8_3d00bdc0-a115-44e1-ae0c-f19613d67607/payload-processing/0.log"
Jul 17 15:44:34.751845 ip-10-0-143-54 kubenswrapper[2561]: I0717 15:44:34.751806    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pvb7_a444da6a-896e-4cf9-8707-e37a52512923/konnectivity-agent/0.log" limit=1024